00000001:02000400:2.0F:1790391067.323986:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_hostid 00000001:02000400:2.0:1790391088.512812:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1790391090.694897:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 650 MB/s 00000001:01000000:3.0F:1790391090.945966:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 767 MB/s 00000001:01000000:0.0:1790391091.196176:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4318 MB/s 00000020:02000000:2.0:1790391092.000093:0:3276:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g2dccaf1 00000400:02000000:1.0F:1790391093.138416:0:3291:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.108@tcp [8/256/0/180] 00008000:02000000:1.0:1790391097.161768:0:3441:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1790391147.431418:0:5242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790391155.918390:0:5817:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790391155.918396:0:5817:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790391155.918523:0:5817:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002f69c30d 00000080:02000400:1.0:1790391155.918535:0:5817:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1790391155.925147:0:5817:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790391155.925165:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790391155.925209:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000033481e9e) 00000020:00000080:1.0:1790391155.925229:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790391155.939820:0:5817:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1790391155.940347:0:5817:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790391155.961944:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1790391155.961978:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790391155.961996:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1790391155.962175:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790391155.962199:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790391155.963461:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790391155.963471:0:5817:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790391155.963553:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449a3d2 00000020:01000004:1.0:1790391155.963563:0:5817:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790391155.963568:0:5817:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790391155.963572:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f69c30d from MGS 00000020:01000004:1.0:1790391155.963577:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790391155.963726:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003a003052) 00000020:00000080:1.0:1790391155.963740:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790391155.963800:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f69c30d from MGS, refs=2 00080000:01000000:1.0:1790391155.963805:0:5817:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790391155.963810:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449a3e0 00000100:00100000:1.0:1790391155.963933:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790391155.965440:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790391155.965449:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790391155.966120:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790391155.966127:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790391155.967253:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391155.967729:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790391155.967736:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790391155.968450:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790391155.968459:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790391155.968985:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790391155.968991:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790391155.971649:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391155.971656:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391155.971659:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391155.972189:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391155.972192:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391155.972193:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391155.973088:0:5817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790391155.978457:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790391156.222073:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4507 MB/s 00000001:01000000:2.0:1790391156.472232:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3311 MB/s 00000001:01000000:1.0:1790391156.725283:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 505 MB/s 00000001:01000000:2.0:1790391156.975363:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 723 MB/s 00080000:10000000:2.0:1790391156.983186:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1790391157.002801:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1790391157.002819:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790391157.002821:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790391157.006450:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790391157.006668:0:5817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790391157.006732:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790391157.006973:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790391157.007002:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790391157.008724:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391157.008894:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790391157.008901:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790391157.010254:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790391157.010330:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790391157.010759:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790391157.010766:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790391157.011743:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790391157.011763:0:5817:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.108@tcp' 00000020:01000004:2.0:1790391157.011766:0:5817:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790391157.011818:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.108@tcp (typ=mgc) 00000020:00000080:2.0:1790391157.011839:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.108@tcp (00000000799ea843) 00000020:00000080:2.0:1790391157.011859:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790391157.011995:0:5817:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005e91ce1a@MGC192.168.201.108@tcp: add connection 192.168.201.108@tcp at head 00000100:00080000:3.0:1790391157.012472:0:5832:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1790391157.015416:0:5817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.108@tcp-0 is initialized 00000040:01000000:2.0:1790391157.015427:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 1 is initialized 10000000:01000000:0.0:1790391157.016300:0:5833:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790391157.016353:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.108@tcp (uuid 2c86877e-0672-4feb-acd6-39a38006ba27) 00000020:00000080:0.0:1790391157.016378:0:5817:0:(genops.c:1385:class_connect()) connect: client 2c86877e-0672-4feb-acd6-39a38006ba27, cookie 0x35e94fc15449a3ee 00000100:00080000:0.0:1790391157.016390:0:5817:0:(import.c:545:import_select_connection()) MGC192.168.201.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391157.016395:0:5817:0:(import.c:665:import_select_connection()) MGC192.168.201.108@tcp: import 000000005e91ce1a using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391157.016437:0:5817:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000304703db x1877361130733696/t0(0) o250->MGC192.168.201.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391157.016562:0:5817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2c86877e-0672-4feb-acd6-39a38006ba27->MGS 00000020:01000004:0.0:1790391157.016581:0:5817:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790391157.016605:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790391157.016626:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000023578a33) 00000020:00000080:0.0:1790391157.016637:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790391157.017378:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000304703db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c86877e-0672-4feb-acd6-39a38006ba27:3306:1877361130733696:0@lo:250: 00000100:00100000:3.0:1790391157.017475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391157.018789:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130733696 00000100:00100000:2.0:1790391157.018801:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130733696 00000100:00100000:2.0:1790391157.018831:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391157.018838:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e11f857a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1877361130733696:12345-0@lo:250: 00010000:00080000:2.0:1790391157.018862:0:5829:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2c86877e-0672-4feb-acd6-39a38006ba27@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1790391157.018887:0:5829:0:(genops.c:1385:class_connect()) connect: client 2c86877e-0672-4feb-acd6-39a38006ba27, cookie 0x35e94fc15449a3fc 00000100:00080000:2.0:1790391157.019357:0:5829:0:(import.c:65:import_set_state_nolock()) 00000000f5b7337b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391157.019445:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e11f857a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+5:3306:x1877361130733696:12345-0@lo:250: Request processed in 605us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391157.019453:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391157.019492:0:3306:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790391157.019502:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.108@tcp: connect to target with instance 0 00000100:00080000:2.0:1790391157.019510:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790391157.019514:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790391157.019517:0:3306:0:(import.c:65:import_set_state_nolock()) 000000005e91ce1a MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790391157.020378:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790391157.020395:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790391157.020402:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000304703db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c86877e-0672-4feb-acd6-39a38006ba27:3306:1877361130733696:0@lo:250: 00010000:00010000:0.0:1790391157.023616:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391157.042125:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391157.043341:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790391157.043349:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790391157.044545:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391157.044557:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790391157.044939:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790391157.044946:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790391157.047692:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391157.047889:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790391157.047895:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790391157.050872:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790391157.050886:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790391157.093682:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391157.093903:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790391157.093910:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790391157.096463:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790391157.096477:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790391157.097277:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391157.097449:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391157.097454:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790391157.098123:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391157.098130:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790391157.098752:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391157.098903:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391157.098908:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790391157.101643:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391157.101668:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790391157.102458:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391157.102644:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391157.103865:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790391157.104604:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391157.104611:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790391157.141394:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391157.141608:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790391157.141615:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790391157.145807:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790391157.145822:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790391157.148807:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790391157.148818:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790391157.150713:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790391157.150737:0:5817:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790391157.150743:0:5817:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790391157.150857:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790391157.150889:0:5817:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790391157.150892:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790391157.150894:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790391157.150895:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391157.150896:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391157.150897:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391157.150898:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391157.150899:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790391157.150900:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790391157.150902:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391157.150903:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391157.150904:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391157.150905:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391157.150908:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790391157.150910:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790391157.150911:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790391157.150912:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391157.150913:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391157.150914:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391157.150915:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391157.150916:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790391157.150917:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790391157.150918:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391157.150919:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391157.150920:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391157.150920:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391157.150955:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790391157.150971:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095d6f796 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130733824:0@lo:253: 00000100:00100000:3.0:1790391157.151340:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391157.151429:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130733824 00000100:00100000:2.0:1790391157.151436:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130733824 00000100:00100000:2.0:1790391157.151469:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391157.151475:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4f6b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+5:5817:x1877361130733824:12345-0@lo:253: 20000000:01000000:2.0:1790391157.151514:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790391157.151516:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:3.0:1790391157.151698:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048829c8a going to sleep for 11 seconds 10000000:01000000:2.0:1790391157.151814:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790391157.151870:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1790391157.152153:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391157.152998:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1790391157.155681:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790391157.155687:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1790391157.155693:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1790391157.155696:0:5831:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1790391157.155711:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1790391157.155972:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391157.157756:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1790391157.157783:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790391157.157844:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1790391157.157896:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1790391157.157935:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1790391157.158156:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1790391157.158165:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1790391157.158224:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1790391157.158234:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1790391157.158382:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1790391157.158391:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1790391157.158426:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1790391157.158475:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1790391157.158510:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790391157.158517:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1790391157.158531:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391157.158742:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1790391157.158752:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790391157.158788:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1790391157.158822:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1790391157.158866:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1790391157.158878:0:5831:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1790391157.158948:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1790391157.158957:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790391157.158997:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1790391157.159440:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1790391157.159501:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1790391157.159514:0:5831:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1790391157.159600:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1790391157.159609:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1790391157.159635:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1790391157.159678:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1790391157.159810:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1790391157.159846:0:5831:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1790391157.159853:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1790391157.161908:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1790391157.164437:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1790391157.164467:0:5831:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.108@tcp for mdt 20000000:01000000:1.0:1790391157.164470:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:1.0:1790391157.164508:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1790391157.164516:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790391157.164548:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1790391157.164556:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:1.0:1790391157.164601:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1790391157.164611:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1790391157.164642:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1790391157.164696:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1790391157.164776:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790391157.164780:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790391157.164785:0:5831:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790391157.164793:0:5831:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790391157.165584:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1790391157.165741:0:5831:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1790391157.184869:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1790391157.184922:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1790391157.184998:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1790391157.185825:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790391157.185847:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790391157.185851:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790391157.185866:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790391157.185868:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790391157.185906:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790391157.185908:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790391157.186840:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1790391157.189816:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1790391157.189870:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1790391157.189901:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1790391157.189912:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790391157.189914:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790391157.190725:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1790391157.191183:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1790391157.191385:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1790391157.191450:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1790391157.191464:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391157.191466:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1790391157.191473:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790391157.191493:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191508:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191518:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191524:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191530:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191535:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191552:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001f6cf89a already unused, calling callback (000000001c41396c) 00010000:00010000:1.0:1790391157.191556:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191572:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191583:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191589:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.191594:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001f6cf89a/0x35e94fc15449a403 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790391157.191609:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790391157.457202:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4f6b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+5:5817:x1877361130733824:12345-0@lo:253: Request processed in 305718us (305854us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391157.457224:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391157.457393:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095d6f796 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130733824:0@lo:253: 10000000:01000000:1.0:1790391157.457408:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790391157.457412:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391157.457414:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391157.457416:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391157.457417:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1790391157.457418:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391157.457419:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391157.457420:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391157.457421:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391157.457423:0:5817:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790391157.457424:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391157.457425:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790391157.457443:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f69c30d from lustre-MDT0000 10000000:01000000:1.0:1790391157.457468:0:5817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790391157.457484:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790391157.457488:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff962427f099c0 10000000:01000000:1.0:1790391157.457492:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391157.457501:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962427f099c0 from 1 10000000:01000000:1.0:1790391157.457504:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391157.457555:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.457566:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.457575:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.457594:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130733952:0@lo:101: 00000100:00100000:1.0:1790391157.457628:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.457729:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006686594 going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.458006:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130733952 00000100:00100000:3.0:1790391157.458042:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130733952 00000100:00100000:2.0:1790391157.460928:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391157.460951:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a9ffbf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+5:5817:x1877361130733952:12345-0@lo:101: 00010000:00010000:2.0:1790391157.460970:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391157.461098:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a40a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391157.461128:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a40a expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391157.461138:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a40a expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391157.461147:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d5ca757, rc 0) 00000100:00100000:2.0:1790391157.461227:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a9ffbf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+6:5817:x1877361130733952:12345-0@lo:101: Request processed in 287us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391157.461234:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391157.461457:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130733952:0@lo:101: 00010000:00010000:1.0:1790391157.461475:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.461483:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.461546:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734080:0@lo:501: 00000100:00100000:1.0:1790391157.461582:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.461613:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006686594 going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.461681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734080 00000100:00100000:3.0:1790391157.461688:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734080 00000100:00100000:3.0:1790391157.461714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391157.461720:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7798ddf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+6:5817:x1877361130734080:12345-0@lo:501: 00000100:00100000:3.0:1790391157.461954:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7798ddf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+6:5817:x1877361130734080:12345-0@lo:501: Request processed in 234us (372us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391157.461962:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391157.462063:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734080:0@lo:501: 10000000:01000000:1.0:1790391157.462086:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790391157.462108:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.462116:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391157.462125:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9624081bf000 10000000:01000000:1.0:1790391157.462129:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790391157.462133:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9624081bf000 10000000:01000000:1.0:1790391157.462136:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790391157.462139:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9624081bf000 from 1 10000000:01000000:1.0:1790391157.462142:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790391157.462162:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000ef7a2bc8/0x35e94fc15449a418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.462168:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000ef7a2bc8/0x35e94fc15449a418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.462175:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000ef7a2bc8/0x35e94fc15449a418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.462186:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734208:0@lo:101: 00000100:00100000:1.0:1790391157.462209:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.462229:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006686594 going to sleep for 11 seconds 00000100:00100000:2.0:1790391157.463893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734208 00000100:00100000:2.0:1790391157.463906:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734208 00000100:00100000:2.0:1790391157.463964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391157.463973:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abc0f952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+6:5817:x1877361130734208:12345-0@lo:101: 00010000:00010000:2.0:1790391157.463987:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391157.464004:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075302b3c/0x35e94fc15449a41f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a418 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391157.464054:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075302b3c/0x35e94fc15449a41f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a418 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391157.464064:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075302b3c/0x35e94fc15449a41f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a418 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391157.464085:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075302b3c, rc 0) 00000100:00100000:2.0:1790391157.464141:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abc0f952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+7:5817:x1877361130734208:12345-0@lo:101: Request processed in 169us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391157.464147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391157.465343:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734208:0@lo:101: 00010000:00010000:1.0:1790391157.465365:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000ef7a2bc8/0x35e94fc15449a418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.465375:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000ef7a2bc8/0x35e94fc15449a418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391157.465413:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790391157.465438:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000ef7a2bc8/0x35e94fc15449a418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.465446:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000ef7a2bc8/0x35e94fc15449a418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391157.465452:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790391157.465457:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391157.465463:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9624081bf000 10000000:01000000:1.0:1790391157.465466:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790391157.465469:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790391157.465472:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790391157.465498:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.465505:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.465512:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.465529:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734336:0@lo:101: 00000100:00100000:1.0:1790391157.465580:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.465612:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006686594 going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.465851:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734336 00000100:00100000:0.0:1790391157.465859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734336 00000100:00100000:0.0:1790391157.465902:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391157.465910:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b983823d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+7:5817:x1877361130734336:12345-0@lo:101: 00010000:00010000:0.0:1790391157.465922:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391157.465932:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a426 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.465950:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a426 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.465959:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a426 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.465967:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046281148, rc 0) 00000100:00100000:0.0:1790391157.466057:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b983823d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+8:5817:x1877361130734336:12345-0@lo:101: Request processed in 147us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.466064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391157.466199:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734336:0@lo:101: 00010000:00010000:1.0:1790391157.466210:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.466227:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.466274:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734464:0@lo:501: 00000100:00100000:1.0:1790391157.466300:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.466326:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006686594 going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.467738:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734464 00000100:00100000:3.0:1790391157.467750:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734464 00000100:00100000:3.0:1790391157.467807:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391157.467815:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092a1e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+8:5817:x1877361130734464:12345-0@lo:501: 00000100:00100000:3.0:1790391157.468159:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092a1e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+9:5817:x1877361130734464:12345-0@lo:501: Request processed in 344us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391157.468166:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391157.468793:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734464:0@lo:501: 00000100:00100000:1.0:1790391157.468843:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734592:0@lo:503: 00000100:00100000:1.0:1790391157.468895:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.468931:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006686594 going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.468998:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734592 00000100:00100000:0.0:1790391157.469003:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734592 00000100:00100000:0.0:1790391157.469074:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391157.469081:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eea0c0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+9:5817:x1877361130734592:12345-0@lo:503: 00000100:00100000:0.0:1790391157.469264:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eea0c0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+9:5817:x1877361130734592:12345-0@lo:503: Request processed in 184us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.469271:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391157.469668:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734592:0@lo:503: 00000100:00100000:1.0:1790391157.472378:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5860:1877361130734720:0@lo:502: 00000100:00100000:1.0:1790391157.472451:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.472503:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3b1d965 going to sleep for 11 seconds 00000100:00100000:2.0:1790391157.472719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734720 00000100:00100000:2.0:1790391157.472728:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734720 00000100:00100000:2.0:1790391157.472773:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391157.472781:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e1c810f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+9:5860:x1877361130734720:12345-0@lo:502: 00000100:00100000:2.0:1790391157.473011:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e1c810f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+9:5860:x1877361130734720:12345-0@lo:502: Request processed in 231us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391157.473040:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391157.475283:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5860:1877361130734720:0@lo:502: 00000020:01000000:1.0:1790391157.475329:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391157.475343:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391157.475346:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790391157.475351:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790391157.475354:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391157.475369:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009b5b5609) 00000020:00000080:1.0:1790391157.475388:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790391157.475394:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790391157.475476:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790391157.475482:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449a43b 00000020:00000080:1.0:1790391157.475863:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790391157.475873:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391157.475877:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391157.475878:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790391157.475881:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391157.475885:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391157.475886:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790391157.475889:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391157.475896:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000014d47e9e) 00000020:00000080:1.0:1790391157.475906:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790391157.475910:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790391157.475911:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790391157.475914:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790391157.475920:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790391157.475960:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f69c30d from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790391157.475981:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d8ac0831) 00000020:00000080:1.0:1790391157.475991:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790391157.476419:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790391157.476426:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449a450 00000020:00000080:1.0:1790391157.476538:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790391157.476546:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790391157.476550:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x35e94fc15449a457 00080000:01000000:1.0:1790391157.476555:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790391157.476558:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449a45e 00080000:10000000:1.0:1790391157.477251:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1790391157.477480:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790391157.482464:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1790391157.594905:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1790391157.595239:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1790391157.598461:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1790391157.598746:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790391157.665592:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000df33ee0c) 00000020:00000080:3.0:1790391157.665616:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790391157.665701:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790391157.665709:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449a46c 00000020:00000080:3.0:1790391157.674949:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790391157.676797:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391157.747517:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391157.771755:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391157.813973:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391157.864100:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391157.892931:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790391157.921163:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x35e94fc15449a473 00000020:00000080:2.0:1790391157.921748:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790391157.921758:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391157.921764:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391157.921767:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790391157.921770:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391157.921775:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391157.921777:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790391157.921781:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790391157.921817:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790391157.921831:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391157.921835:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391157.921836:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790391157.921838:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391157.921847:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391157.921849:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391157.921852:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391157.921853:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790391157.921908:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000970437dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5860:1877361130734848:0@lo:502: 00000100:00100000:2.0:1790391157.921982:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391157.922057:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dee8ae47 going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.922124:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734848 00000100:00100000:3.0:1790391157.922132:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734848 00000100:00100000:3.0:1790391157.922175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391157.922183:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000107d258a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+9:5860:x1877361130734848:12345-0@lo:502: 00000100:00100000:3.0:1790391157.922497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000107d258a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+9:5860:x1877361130734848:12345-0@lo:502: Request processed in 313us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391157.922505:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391157.922763:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000970437dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5860:1877361130734848:0@lo:502: 00000020:01000000:0.0:1790391157.922792:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391157.922802:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391157.922803:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790391157.922807:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790391157.922951:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790391157.922973:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790391157.923061:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.923072:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391157.923081:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9624081bf000 from 1 10000000:01000000:3.0:1790391157.923084:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391157.923112:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.923119:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.923127:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391157.923140:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf75cf5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734976:0@lo:101: 00000100:00100000:3.0:1790391157.923172:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391157.923189:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8336738 going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.923280:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130734976 00000100:00100000:0.0:1790391157.923286:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130734976 00000100:00100000:0.0:1790391157.923312:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391157.923320:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b0f92e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+9:5817:x1877361130734976:12345-0@lo:101: 00010000:00010000:0.0:1790391157.923329:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391157.923340:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a47a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.923360:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a47a expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.923369:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a47a expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.923376:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b531f312, rc 0) 00000100:00100000:0.0:1790391157.923406:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b0f92e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+10:5817:x1877361130734976:12345-0@lo:101: Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.923412:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391157.923542:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf75cf5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130734976:0@lo:101: 00010000:00010000:3.0:1790391157.923554:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.923562:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391157.924164:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf75cf5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735104:0@lo:256: 00000100:00100000:3.0:1790391157.924205:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391157.924232:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8336738 going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.924261:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130735104 00000100:00100000:3.0:1790391157.924266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130735104 00000100:00100000:3.0:1790391157.924297:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391157.924303:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80bb2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+10:5817:x1877361130735104:12345-0@lo:256: 20000000:01000000:3.0:1790391157.924319:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790391157.924325:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790391157.924384:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80bb2f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+10:5817:x1877361130735104:12345-0@lo:256: Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391157.924391:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391157.924424:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf75cf5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735104:0@lo:256: 10000000:01000000:3.0:1790391157.925007:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391157.925464:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.925476:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391157.925483:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9624081bf000 from 1 10000000:01000000:3.0:1790391157.925494:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391157.925523:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.925529:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.925536:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391157.925551:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf75cf5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735232:0@lo:101: 00000100:00100000:3.0:1790391157.925600:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391157.925634:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8336738 going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.925701:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130735232 00000100:00100000:0.0:1790391157.925709:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130735232 00000100:00100000:0.0:1790391157.925750:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391157.925757:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064b22813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+10:5817:x1877361130735232:12345-0@lo:101: 00010000:00010000:0.0:1790391157.925766:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391157.925778:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a488 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.925797:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a488 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.925862:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a488 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.925870:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008fff2d6c, rc 0) 00000100:00100000:0.0:1790391157.925915:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064b22813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:5817:x1877361130735232:12345-0@lo:101: Request processed in 159us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.925921:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391157.926135:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf75cf5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735232:0@lo:101: 00010000:00010000:1.0:1790391157.926148:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.926154:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.926210:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735360:0@lo:501: 00000100:00100000:1.0:1790391157.926236:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.926270:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b49685e going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.926367:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130735360 00000100:00100000:0.0:1790391157.926372:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130735360 00000100:00100000:0.0:1790391157.926400:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391157.926405:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007173924c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5817:x1877361130735360:12345-0@lo:501: 00000100:00100000:0.0:1790391157.926967:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007173924c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5817:x1877361130735360:12345-0@lo:501: Request processed in 561us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.926974:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391157.927168:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735360:0@lo:501: 00000100:00100000:1.0:1790391157.927200:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735488:0@lo:503: 00000100:00100000:1.0:1790391157.927250:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.927276:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b49685e going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.927374:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130735488 00000100:00100000:0.0:1790391157.927379:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130735488 00000100:00100000:0.0:1790391157.927415:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391157.927421:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024455bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:5817:x1877361130735488:12345-0@lo:503: 00000040:00080000:0.0:1790391157.927455:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391157.927491:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024455bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:5817:x1877361130735488:12345-0@lo:503: Request processed in 71us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.927497:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391157.927722:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735488:0@lo:503: 00000040:00080000:1.0:1790391157.928690:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790391157.928843:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790391157.928866:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391157.929178:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.929191:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391157.929235:0:5817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790391157.929238:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9624081bf000 10000000:01000000:3.0:1790391157.929307:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9624081bf000 10000000:01000000:3.0:1790391157.929313:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391157.929319:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9624081bf000 from 1 10000000:01000000:3.0:1790391157.929321:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391157.929352:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.929359:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391157.929379:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391157.929398:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e44d5517 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735616:0@lo:101: 00000100:00100000:3.0:1790391157.929452:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391157.929517:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad942f41 going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.929654:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130735616 00000100:00100000:0.0:1790391157.929661:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130735616 00000100:00100000:0.0:1790391157.929739:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391157.929747:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e0c890e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:5817:x1877361130735616:12345-0@lo:101: 00010000:00010000:0.0:1790391157.929767:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391157.929779:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a496 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.929798:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a496 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.929808:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a496 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.929815:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060b430a9, rc 0) 00000100:00100000:0.0:1790391157.929858:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e0c890e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:5817:x1877361130735616:12345-0@lo:101: Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.929864:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391157.929933:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e44d5517 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735616:0@lo:101: 00010000:00010000:1.0:1790391157.929946:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.929953:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.929996:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735744:0@lo:501: 00000100:00100000:1.0:1790391157.930040:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.930160:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5a4228c going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.930223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130735744 00000100:00100000:3.0:1790391157.930228:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130735744 00000100:00100000:3.0:1790391157.930258:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391157.930265:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1cfa55f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5817:x1877361130735744:12345-0@lo:501: 00000100:00100000:3.0:1790391157.930495:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1cfa55f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5817:x1877361130735744:12345-0@lo:501: Request processed in 230us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391157.930502:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391157.930695:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735744:0@lo:501: 00000100:00100000:1.0:1790391157.930723:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735872:0@lo:503: 00000100:00100000:1.0:1790391157.930760:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.930781:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5a4228c going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.930827:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130735872 00000100:00100000:3.0:1790391157.930831:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130735872 00000100:00100000:3.0:1790391157.930850:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391157.930855:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035c1033d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5817:x1877361130735872:12345-0@lo:503: 00000100:00100000:3.0:1790391157.931088:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035c1033d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5817:x1877361130735872:12345-0@lo:503: Request processed in 233us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391157.931095:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391157.931176:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130735872:0@lo:503: 00000100:00100000:1.0:1790391157.931811:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5865:1877361130736000:0@lo:502: 00000100:00100000:1.0:1790391157.931850:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.931880:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c56e911 going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.931921:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736000 00000100:00100000:0.0:1790391157.931927:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736000 00000100:00100000:0.0:1790391157.931961:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391157.931968:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb6c5a87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5865:x1877361130736000:12345-0@lo:502: 00000100:00100000:0.0:1790391157.933925:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb6c5a87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5865:x1877361130736000:12345-0@lo:502: Request processed in 1952us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.933938:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391157.934080:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5865:1877361130736000:0@lo:502: 00000020:01000004:1.0:1790391157.934141:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790391157.934156:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cc55d7f5) 00000020:00000080:1.0:1790391157.934175:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790391157.934265:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f69c30d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790391157.934269:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002f69c30d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790391157.934271:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002f69c30d 4 00010000:00080000:1.0:1790391157.934298:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae06aff2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:0.0:1790391157.936796:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1790391157.937195:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790391157.937233:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790391157.937255:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x35e94fc15449a4ab 00000100:00080000:0.0:1790391157.937265:0:5865:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391157.937270:0:5865:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ae06aff2 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391157.937307:0:5865:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000047d0b061 x1877361130736128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391157.937375:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047d0b061 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130736128:0@lo:38: 00000100:00100000:2.0:1790391157.937442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391157.937552:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736128 00000100:00100000:3.0:1790391157.937561:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736128 00000100:00100000:3.0:1790391157.937603:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391157.937609:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f1b0b22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1877361130736128:12345-0@lo:38: 00000100:00080000:0.0:1790391157.937735:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790391157.939629:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f1b0b22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1877361130736128:12345-0@lo:38: Request processed in 2015us (2183us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790391157.939651:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391157.942087:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1e4c2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5865:1877361130736256:0@lo:502: 00000100:00100000:3.0:1790391157.942184:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391157.942224:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736256 00000100:00100000:3.0:1790391157.942232:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736256 00000100:00100000:3.0:1790391157.942757:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391157.942767:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb545ac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5865:x1877361130736256:12345-0@lo:502: 00000100:00100000:3.0:1790391157.942996:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb545ac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5865:x1877361130736256:12345-0@lo:502: Request processed in 230us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391157.943004:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391157.943083:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8336738 going to sleep for 11 seconds 00000100:00100000:3.0:1790391157.943106:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1e4c2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:5865:1877361130736256:0@lo:502: 00000040:00080000:3.0:1790391157.943147:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1790391157.943960:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1790391157.943982:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391157.947307:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.947323:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790391157.947380:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790391157.947382:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391157.947383:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391157.947384:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391157.947385:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391157.947387:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391157.947388:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391157.947390:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391157.947391:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391157.947392:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391157.947393:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391157.947395:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391157.947398:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1790391157.947401:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391157.947402:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391157.947403:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391157.947404:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391157.947405:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391157.947406:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391157.947408:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391157.947408:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391157.947409:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391157.947410:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391157.947411:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391157.947412:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391157.947440:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790391157.947463:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000155d45f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130736384:0@lo:253: 00000100:00100000:0.0:1790391157.947528:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391157.947564:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e944620 going to sleep for 11 seconds 00000100:00100000:2.0:1790391157.947803:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790391157.947811:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000ae06aff2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391157.947815:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790391157.947818:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047d0b061 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130736128:0@lo:38: 00000100:00100000:0.0:1790391157.948315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736384 00000100:00100000:0.0:1790391157.948323:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736384 00000100:00100000:0.0:1790391157.948372:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391157.948381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006af21b0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:5817:x1877361130736384:12345-0@lo:253: 20000000:01000000:0.0:1790391157.948408:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790391157.948422:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790391157.992044:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790391157.992057:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790391157.992120:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790391157.992124:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790391157.992145:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.992164:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a47a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.992173:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.992226:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a47a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.992252:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a47a expref: 12 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391157.992268:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1877361130736512:0@lo:104: 00000100:00100000:1.0:1790391157.992333:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391157.992389:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b49685e going to sleep for 11 seconds 00000100:00100000:0.0:1790391157.993627:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736512 00000100:00100000:0.0:1790391157.993647:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736512 00000100:00100000:0.0:1790391157.993694:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391157.993702:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000527d9865 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5852:x1877361130736512:12345-0@lo:104: 00010000:00010000:0.0:1790391157.993718:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.993800:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391157.993805:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000527d9865 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5852:x1877361130736512:12345-0@lo:104: Request processed in 105us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391157.993812:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790391157.993833:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391157.993838:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.993845:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efb7ebf1 already unused, calling callback (00000000d4b4f432) 10000000:00010000:0.0:1790391157.993849:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.993868:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391157.993875:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391157.993880:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391157.993913:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.993920:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391157.993934:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.993941:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 00000000efb7ebf1/0x35e94fc15449a47a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a481 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.993960:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391157.993961:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391157.993963:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391157.994109:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1877361130736512:0@lo:104: 00010000:00010000:1.0:1790391157.994130:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391157.994966:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047d1d0a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130736640:0@lo:103: 00000100:00100000:3.0:1790391157.995043:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391157.995178:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736640 00000100:00100000:0.0:1790391157.995185:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736640 00010000:00010000:0.0:1790391157.995207:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a47a expref: 13 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391157.995392:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391157.995453:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec1e4c2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+13:3308:x1877361130736640:12345-0@lo:103: 00010000:00010000:1.0:1790391157.995467:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391157.995473:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a47a expref: 13 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995483:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a47a expref: 13 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995497:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b531f312/0x35e94fc15449a481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a47a expref: 13 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995509:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995516:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790391157.995541:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003416367s 00010000:00010000:1.0:1790391157.995545:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995551:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995557:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995563:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995568:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000671f002a already unused, calling callback (000000001c41396c) 00010000:00010000:1.0:1790391157.995571:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995587:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995607:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391157.995616:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391157.995682:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec1e4c2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+12:3308:x1877361130736640:12345-0@lo:103: Request processed in 283us (667us total) trans 0 rc 0/0 00010000:00010000:0.0:1790391157.995780:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.995788:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391157.995799:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000671f002a/0x35e94fc15449a4b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391157.995923:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047d1d0a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130736640:0@lo:103: 00000100:00100000:1.0:1790391157.995968:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391158.001977:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006af21b0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5817:x1877361130736384:12345-0@lo:253: Request processed in 53589us (54440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391158.001998:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391158.002187:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000155d45f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:5817:1877361130736384:0@lo:253: 10000000:01000000:0.0:1790391158.002204:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790391158.002208:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391158.002209:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391158.002211:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391158.002212:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391158.002213:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391158.002214:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391158.002215:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391158.002216:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391158.002217:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391158.002219:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391158.002220:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391158.002221:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790391158.002236:0:5817:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790391158.008970:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790391158.009488:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790391158.009881:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790391158.010082:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790391158.010355:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790391158.010535:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790391158.011398:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790391158.011653:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790391158.011854:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790391158.012061:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790391158.012385:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790391158.012653:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:2.0:1790391158.042684:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1790391158.051134:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1790391158.079042:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1790391158.079383:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790391158.082492:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790391158.082768:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790391158.083195:0:5817:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790391158.083202:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790391158.083328:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1790391158.083733:0:5870:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1790391158.083738:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1790391158.084887:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790391158.085543:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790391158.085631:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790391158.085867:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790391158.086097:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1790391158.089485:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790391158.089827:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790391158.089974:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790391158.090154:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790391158.090383:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790391158.090567:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790391158.090815:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790391158.090973:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790391158.091201:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790391158.091359:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790391158.091517:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790391158.091744:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790391158.091881:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790391158.096154:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790391158.096406:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790391158.096552:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790391158.101216:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790391158.101363:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790391158.101533:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790391158.101701:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790391158.101859:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790391158.102044:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790391158.102206:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790391158.102349:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790391158.102497:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790391158.104071:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790391158.104358:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790391158.104513:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790391158.104687:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790391158.104838:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790391158.104989:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790391158.105159:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790391158.105362:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1790391158.129436:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790391158.177766:0:5817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790391158.177802:0:5817:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe8c1dbb988 00100000:10000000:1.0:1790391158.177811:0:5817:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790391158.180962:0:5817:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790391158.180979:0:5817:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790391158.180990:0:5817:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790391158.181162:0:5817:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1790391158.181533:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790391158.181583:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790391158.181587:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1790391159.068497:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391160.089313:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391161.113747:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391162.137299:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391162.900398:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790391163.162286:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391163.290048:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790391163.290057:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391163.290060:0:8:0:(import.c:65:import_set_state_nolock()) 00000000ae06aff2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391163.290070:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ae06aff2 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391163.290096:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000acfe993c x1877361130736896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391163.290243:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391163.290255:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000155d45f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130736768:0@lo:400: 00000100:00100000:2.0:1790391163.290313:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391163.290373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acfe993c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130736896:0@lo:38: 00000100:00100000:2.0:1790391163.290408:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391163.290638:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736768 00000100:00100000:0.0:1790391163.290646:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736768 00000100:00100000:0.0:1790391163.290699:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391163.290707:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009228493b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:3310:x1877361130736768:12345-0@lo:400: 00000100:00100000:0.0:1790391163.290777:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009228493b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:3310:x1877361130736768:12345-0@lo:400: Request processed in 70us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391163.290785:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391163.290825:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130736896 00000100:00100000:0.0:1790391163.290828:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130736896 00000100:00100000:0.0:1790391163.290857:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391163.290861:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000521b843d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1877361130736896:12345-0@lo:38: 00010000:00080000:0.0:1790391163.290883:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1790391163.290923:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x35e94fc15449a4b9 00000004:00100000:0.0:1790391163.290972:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1790391163.291249:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000155d45f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130736768:0@lo:400: 00000100:00080000:0.0:1790391163.292584:0:5838:0:(import.c:65:import_set_state_nolock()) 00000000e601f2bf : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391163.292670:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000521b843d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877361130736896:12345-0@lo:38: Request processed in 1806us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391163.292680:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790391163.292870:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000acfe993c x1877361130736896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391163.292887:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790391163.292894:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790391163.292898:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790391163.292900:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000ae06aff2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790391163.292904:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acfe993c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130736896:0@lo:38: 00010000:00010000:1.0:1790391164.185345:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391165.211221:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391166.237204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790391166.873071:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790391166.873079:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9624081bf000 from 3 10000000:01000000:3.0:1790391166.873084:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391166.873135:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000007c63dbe4/0x35e94fc15449a4c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391166.873147:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000007c63dbe4/0x35e94fc15449a4c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391166.873170:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000007c63dbe4/0x35e94fc15449a4c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391166.873192:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce26fc92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130737024:0@lo:101: 00000100:00100000:3.0:1790391166.873255:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391166.873308:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000187cb6b2 going to sleep for 11 seconds 00000100:00100000:1.0:1790391166.873540:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737024 00000100:00100000:1.0:1790391166.873549:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737024 00000100:00100000:1.0:1790391166.873613:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391166.873622:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ce0813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130737024:12345-0@lo:101: 00010000:00010000:1.0:1790391166.873634:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391166.873648:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c8dd997/0x35e94fc15449a4c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a4c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391166.873672:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c8dd997/0x35e94fc15449a4c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391166.873682:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c8dd997/0x35e94fc15449a4c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391166.873690:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c8dd997, rc 0) 00000100:00100000:1.0:1790391166.873732:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ce0813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:5833:x1877361130737024:12345-0@lo:101: Request processed in 112us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391166.873739:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790391166.873810:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce26fc92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130737024:0@lo:101: 00010000:00010000:3.0:1790391166.873827:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000007c63dbe4/0x35e94fc15449a4c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391166.873836:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000007c63dbe4/0x35e94fc15449a4c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391166.873894:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce26fc92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130737152:0@lo:256: 00000100:00100000:3.0:1790391166.873925:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391166.873946:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000187cb6b2 going to sleep for 11 seconds 00000100:00100000:1.0:1790391166.874556:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737152 00000100:00100000:1.0:1790391166.874562:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737152 00000100:00100000:1.0:1790391166.874599:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391166.874604:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097c33f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5833:x1877361130737152:12345-0@lo:256: 20000000:01000000:1.0:1790391166.874616:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790391166.874630:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790391166.874635:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790391166.874715:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097c33f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5833:x1877361130737152:12345-0@lo:256: Request processed in 111us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391166.874720:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790391166.874911:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce26fc92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130737152:0@lo:256: 10000000:01000000:3.0:1790391166.874968:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391166.874976:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000007c63dbe4/0x35e94fc15449a4c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391166.874986:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000007c63dbe4/0x35e94fc15449a4c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391167.257492:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790391167.946965:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7f7ba4d0 20000000:00000080:1.0:1790391167.946984:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96241ffab800 uarg=0000000000000000 20000000:01000000:1.0:1790391167.947747:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790391167.947756:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790391167.947761:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790391167.948130:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790391167.948141:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790391167.953658:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391167.954004:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790391167.954270:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1790391167.954323:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1790391167.954341:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790391167.954359:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.954377:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a488 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.954384:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.954423:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a488 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.954449:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a488 expref: 11 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391167.954463:0:6316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1877361130737280:0@lo:104: 00000100:00100000:1.0:1790391167.954537:0:6316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391167.954593:0:6316:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9698bf8 going to sleep for 11 seconds 00000100:00100000:3.0:1790391167.954655:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737280 00000100:00100000:3.0:1790391167.954663:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737280 00000100:00100000:3.0:1790391167.954724:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391167.954732:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023715827 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+3:6316:x1877361130737280:12345-0@lo:104: 00010000:00010000:3.0:1790391167.954744:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391167.954802:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391167.954807:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023715827 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+3:6316:x1877361130737280:12345-0@lo:104: Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391167.954814:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391167.954918:0:6316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f60823 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1877361130737280:0@lo:104: 00010000:00010000:2.0:1790391167.954938:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.954998:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391167.955004:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955011:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f23fe3b2 already unused, calling callback (00000000d4b4f432) 10000000:00010000:1.0:1790391167.955149:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955159:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391167.955164:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391167.955169:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391167.955252:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955260:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391167.955284:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955291:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 00000000f23fe3b2/0x35e94fc15449a488 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a48f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955317:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391167.955319:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391167.955321:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391167.955328:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391167.955339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e61e6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130737408:0@lo:103: 00000100:00100000:1.0:1790391167.955370:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391167.955403:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737408 00000100:00100000:1.0:1790391167.955408:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737408 00010000:00010000:1.0:1790391167.955427:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a488 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391167.955449:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391167.955455:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b86028b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+12:3309:x1877361130737408:12345-0@lo:103: 00010000:00010000:1.0:1790391167.955466:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391167.955482:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a488 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955492:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a488 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955504:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a48f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a488 expref: 12 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955515:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955522:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955543:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955549:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955554:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955560:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955564:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004360f057 already unused, calling callback (000000001c41396c) 00010000:00010000:1.0:1790391167.955567:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955573:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955593:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391167.955602:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391167.955630:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b86028b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+11:3309:x1877361130737408:12345-0@lo:103: Request processed in 176us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391167.955636:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391167.955664:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e61e6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130737408:0@lo:103: 00010000:00010000:3.0:1790391167.960357:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391167.960376:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391167.960383:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004360f057/0x35e94fc15449a4ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391168.281262:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391168.409802:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391168.409827:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce26fc92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130737536:0@lo:400: 00000100:00100000:2.0:1790391168.409907:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391168.410100:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737536 00000100:00100000:3.0:1790391168.410109:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737536 00000100:00100000:3.0:1790391168.410173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391168.410182:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e226bbe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130737536:12345-0@lo:400: 00000100:00100000:3.0:1790391168.410243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e226bbe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130737536:12345-0@lo:400: Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391168.410250:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790391168.410399:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ce26fc92 x1877361130737536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391168.410431:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce26fc92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130737536:0@lo:400: 00010000:00010000:0.0:1790391169.310340:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391170.329217:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391171.353866:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391172.377911:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391173.403154:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391173.531294:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391173.531317:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b68ab48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130737664:0@lo:400: 00000100:00100000:0.0:1790391173.531394:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391173.531455:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f07105ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130737792:0@lo:400: 00000100:00100000:0.0:1790391173.531487:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391173.531522:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737792 00000100:00100000:0.0:1790391173.531529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737792 00000100:00100000:0.0:1790391173.531586:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391173.531594:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca1d8847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130737792:12345-0@lo:400: 00000100:00100000:0.0:1790391173.531644:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca1d8847 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130737792:12345-0@lo:400: Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391173.531652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790391173.531691:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f07105ec x1877361130737792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391173.531705:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f07105ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130737792:0@lo:400: 00000100:00100000:1.0:1790391173.531976:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737664 00000100:00100000:1.0:1790391173.531981:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737664 00000100:00100000:1.0:1790391173.532042:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391173.532048:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f87ce37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:3307:x1877361130737664:12345-0@lo:400: 00000100:00100000:1.0:1790391173.532095:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f87ce37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:3307:x1877361130737664:12345-0@lo:400: Request processed in 48us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391173.532102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391173.532159:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b68ab48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130737664:0@lo:400: 00010000:00010000:3.0:1790391174.428171:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790391175.187104:0:6691:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790391175.187110:0:6691:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790391175.187243:0:6691:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000dd711e4b 00000020:01000004:2.0:1790391175.187261:0:6691:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790391175.187274:0:6691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790391175.187287:0:6691:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000798917b9) 00000020:00000080:2.0:1790391175.187302:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790391175.203847:0:6691:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790391175.204263:0:6691:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790391175.258602:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790391175.266328:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790391175.266389:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790391175.266474:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790391175.266506:0:6691:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790391175.267135:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790391175.267146:0:6691:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391175.267157:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x35e94fc15449a4dc 00000020:01000004:2.0:1790391175.267165:0:6691:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790391175.267185:0:6691:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391175.267187:0:6691:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391175.267193:0:6691:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790391175.267197:0:6691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790391175.267206:0:6691:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000f018ec76) 00000020:00000080:2.0:1790391175.267216:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790391175.269493:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391175.269691:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790391175.269699:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790391175.272092:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790391175.272104:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790391175.273431:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790391175.273441:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790391175.274692:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391175.274871:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790391175.274877:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790391175.278636:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790391175.278649:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790391175.331186:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391175.331578:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790391175.331586:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790391175.337180:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790391175.337197:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790391175.337948:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790391175.337966:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790391175.340397:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391175.340608:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790391175.340615:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790391175.341459:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790391175.341466:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790391175.422006:0:6691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391175.422223:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790391175.422231:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790391175.424991:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790391175.425005:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1790391175.426276:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1790391175.426300:0:6691:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1790391175.426305:0:6691:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:1.0:1790391175.450418:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790391175.468290:0:6691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790391175.468386:0:6691:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1790391175.468391:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790391175.468392:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391175.468394:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391175.468395:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391175.468396:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391175.468397:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391175.468398:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391175.468400:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391175.468401:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391175.468415:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391175.468416:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391175.468420:0:6691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1790391175.468422:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391175.468424:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391175.468425:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391175.468425:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391175.468426:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391175.468427:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391175.468428:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391175.468429:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391175.468430:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391175.468431:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391175.468432:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391175.468455:0:6691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790391175.468471:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f07105ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130737920:0@lo:253: 00000100:00100000:0.0:1790391175.468538:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.468580:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b526853 going to sleep for 11 seconds 00000100:00100000:3.0:1790391175.468656:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130737920 00000100:00100000:3.0:1790391175.468663:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130737920 00000100:00100000:3.0:1790391175.468712:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790391175.468720:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a9771e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:6691:x1877361130737920:12345-0@lo:253: 20000000:01000000:3.0:1790391175.468772:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790391175.468776:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790391175.468781:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790391175.468784:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790391175.469768:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391175.469954:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1790391175.469966:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790391175.469998:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1790391175.470004:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790391175.470051:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1790391175.470102:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1790391175.470463:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790391175.470482:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:3.0:1790391175.470483:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:3.0:1790391175.470517:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790391175.470526:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790391175.470573:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790391175.470581:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:3.0:1790391175.470611:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790391175.470620:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790391175.470647:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790391175.470695:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1790391175.471426:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790391175.471444:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:3.0:1790391175.471446:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:3.0:1790391175.471478:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790391175.471487:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790391175.471518:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790391175.471525:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:3.0:1790391175.471587:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790391175.471598:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790391175.471639:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1790391175.471695:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1790391175.471711:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790391175.471714:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790391175.471717:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790391175.471729:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790391175.471731:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790391175.471763:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790391175.471765:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790391175.472759:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790391175.473061:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790391175.473105:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790391175.473163:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1790391175.473176:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790391175.473178:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790391175.473756:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790391175.473805:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790391175.473851:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1790391175.474129:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1790391175.474168:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1790391175.474202:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1790391175.474227:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790391175.474229:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790391175.474755:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1790391175.474800:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1790391175.474865:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1790391175.475733:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1790391175.475770:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1790391175.475829:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1790391175.475845:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790391175.475848:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790391175.475858:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790391175.475878:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.475900:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a40a expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.475918:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a426 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.475924:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a496 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.475931:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.475969:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a496 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.475983:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a496 expref: 11 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.475997:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfb17c76 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1877361130738048:0@lo:104: 00000100:00100000:0.0:1790391175.476095:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391175.476146:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a426 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.476154:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a426 expref: 11 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.476161:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce7d8090 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1877361130738176:0@lo:104: 00000100:00100000:0.0:1790391175.476182:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391175.476204:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a40a expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.476212:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a40a expref: 11 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.476233:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029642980 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1877361130738304:0@lo:104: 00000100:00100000:0.0:1790391175.476256:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.476266:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ca35b3 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.476376:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738048 00000100:00100000:1.0:1790391175.476384:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738048 00000100:00100000:1.0:1790391175.476432:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738176 00000100:00100000:1.0:1790391175.476434:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738176 00000100:00100000:1.0:1790391175.476445:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738304 00000100:00100000:1.0:1790391175.476447:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738304 00000100:00100000:1.0:1790391175.476459:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391175.476466:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000017558b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:5829:x1877361130738048:12345-0@lo:104: 00010000:00010000:1.0:1790391175.476481:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476533:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391175.476537:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000017558b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:5829:x1877361130738048:12345-0@lo:104: Request processed in 72us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.476544:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391175.476562:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391175.476567:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099924f32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:5829:x1877361130738176:12345-0@lo:104: 00010000:00010000:1.0:1790391175.476574:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476604:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790391175.476607:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099924f32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:5829:x1877361130738176:12345-0@lo:104: Request processed in 43us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.476613:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391175.476625:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391175.476638:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad33970b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5829:x1877361130738304:12345-0@lo:104: 00010000:00010000:1.0:1790391175.476645:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476672:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790391175.476676:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad33970b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5829:x1877361130738304:12345-0@lo:104: Request processed in 40us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.476681:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1790391175.476696:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790391175.476701:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476707:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068241596 already unused, calling callback (00000000d4b4f432) 10000000:00010000:1.0:1790391175.476711:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476719:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391175.476724:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391175.476730:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391175.476760:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476766:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391175.476782:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476798:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 0000000068241596/0x35e94fc15449a496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a49d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476811:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391175.476813:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476818:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000378df2e0 already unused, calling callback (00000000d4b4f432) 10000000:00010000:1.0:1790391175.476820:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476825:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391175.476830:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391175.476834:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391175.476846:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476851:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391175.476863:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476869:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 00000000378df2e0/0x35e94fc15449a426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a42d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476877:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391175.476884:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476889:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001f6cf89a already unused, calling callback (00000000d4b4f432) 10000000:00010000:1.0:1790391175.476891:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476896:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391175.476900:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391175.476904:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391175.476916:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476921:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391175.476924:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476929:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a40a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a411 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.476940:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391175.476941:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391175.476942:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391175.476949:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391175.476968:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e61e6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130738432:0@lo:103: 00000100:00100000:1.0:1790391175.476997:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.477067:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063ff876b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130738560:0@lo:103: 00000100:00100000:1.0:1790391175.477097:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.477118:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391175.477123:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd24efe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130738688:0@lo:103: 00000100:00100000:1.0:1790391175.477142:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.477170:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738432 00000100:00100000:1.0:1790391175.477174:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738432 00010000:00010000:1.0:1790391175.477194:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a496 expref: 12 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.477210:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738560 00000100:00100000:1.0:1790391175.477212:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738560 00010000:00010000:1.0:1790391175.477222:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a426 expref: 13 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.477231:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738688 00000100:00100000:1.0:1790391175.477233:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738688 00010000:00010000:1.0:1790391175.477242:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a40a expref: 14 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.477252:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391175.477261:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d595af76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+14:3310:x1877361130738432:12345-0@lo:103: 00010000:00010000:1.0:1790391175.477270:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391175.477274:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a496 expref: 14 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477282:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a496 expref: 14 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477297:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391175.477324:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d595af76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+14:3310:x1877361130738432:12345-0@lo:103: Request processed in 67us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.477337:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391175.477364:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391175.477369:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000255d140e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+13:3307:x1877361130738560:12345-0@lo:103: 00010000:00010000:1.0:1790391175.477376:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391175.477379:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a426 expref: 13 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477386:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a426 expref: 13 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477395:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391175.477420:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000255d140e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+13:3307:x1877361130738560:12345-0@lo:103: Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.477425:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391175.477438:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391175.477442:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030df6217 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+12:3307:x1877361130738688:12345-0@lo:103: 00010000:00010000:1.0:1790391175.477449:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391175.477451:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a40a expref: 12 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477458:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a40a expref: 12 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477468:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477475:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477495:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477502:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477507:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477512:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477517:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fff2d6c already unused, calling callback (000000001c41396c) 00010000:00010000:1.0:1790391175.477520:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477527:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477534:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477543:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391175.477567:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030df6217 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+12:3307:x1877361130738688:12345-0@lo:103: Request processed in 125us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.477572:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391175.477614:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e61e6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130738432:0@lo:103: 00000100:00100000:1.0:1790391175.477640:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd24efe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130738688:0@lo:103: 00000100:00100000:1.0:1790391175.477647:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063ff876b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130738560:0@lo:103: 00010000:00010000:1.0:1790391175.477680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060b430a9/0x35e94fc15449a49d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a496 expref: 11 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.477689:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfb17c76 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1877361130738048:0@lo:104: 00010000:00010000:1.0:1790391175.477695:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046281148/0x35e94fc15449a42d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a426 expref: 10 pid: 5829 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.477701:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce7d8090 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1877361130738176:0@lo:104: 00010000:00010000:1.0:1790391175.477708:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004d5ca757/0x35e94fc15449a411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a40a expref: 9 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.477715:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029642980 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1877361130738304:0@lo:104: 00010000:00010000:1.0:1790391175.477728:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477735:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477739:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.477743:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008fff2d6c/0x35e94fc15449a4ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790391175.477756:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 10000000:01000000:1.0:1790391175.553112:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391175.553119:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9624081bf000 from 21 10000000:01000000:1.0:1790391175.553124:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391175.553168:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a4f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.553193:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a4f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.553204:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a4f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.553228:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063ff876b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130738816:0@lo:101: 00000100:00100000:1.0:1790391175.553301:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.553375:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 000000007555ae0c going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.553456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738816 00000100:00100000:2.0:1790391175.553464:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738816 00000100:00100000:2.0:1790391175.553511:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391175.553520:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3971daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+9:5833:x1877361130738816:12345-0@lo:101: 00010000:00010000:2.0:1790391175.553532:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391175.553545:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a642026e/0x35e94fc15449a4f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a4f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.553566:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a642026e/0x35e94fc15449a4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.553587:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a642026e/0x35e94fc15449a4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.553596:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a642026e, rc 0) 00000100:00100000:2.0:1790391175.553650:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3971daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:5833:x1877361130738816:12345-0@lo:101: Request processed in 131us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.553657:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391175.553702:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063ff876b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130738816:0@lo:101: 00010000:00010000:2.0:1790391175.553715:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a4f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.553722:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a4f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391175.553779:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130738944:0@lo:501: 00000100:00100000:2.0:1790391175.553801:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.553812:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1dd7558 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.553822:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130738944 00000100:00100000:2.0:1790391175.553825:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130738944 00000100:00100000:2.0:1790391175.554066:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391175.554071:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cee209e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:5833:x1877361130738944:12345-0@lo:501: 00000100:00100000:2.0:1790391175.554262:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cee209e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:5833:x1877361130738944:12345-0@lo:501: Request processed in 190us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.554268:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391175.554307:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130738944:0@lo:501: 00000100:00100000:2.0:1790391175.554334:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739072:0@lo:503: 00000100:00100000:2.0:1790391175.554381:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.554402:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1dd7558 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.554501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739072 00000100:00100000:2.0:1790391175.554506:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739072 00000100:00100000:2.0:1790391175.554521:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790391175.554525:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee78ec63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:5833:x1877361130739072:12345-0@lo:503: 00000100:00100000:2.0:1790391175.554749:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee78ec63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:5833:x1877361130739072:12345-0@lo:503: Request processed in 223us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.554756:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790391175.554786:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739072:0@lo:503: 00000100:00100000:2.0:1790391175.555066:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6711:1877361130739200:0@lo:502: 00000100:00100000:2.0:1790391175.555097:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.555114:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739200 00000100:00100000:2.0:1790391175.555117:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739200 00000100:00100000:2.0:1790391175.555131:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391175.555136:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001893b61d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:6711:x1877361130739200:12345-0@lo:502: 00000100:00100000:2.0:1790391175.555278:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001893b61d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:6711:x1877361130739200:12345-0@lo:502: Request processed in 141us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.555285:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391175.555561:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d97b231f going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.555576:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6711:1877361130739200:0@lo:502: 00000100:00100000:2.0:1790391175.555906:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6711:1877361130739328:0@lo:502: 00000100:00100000:2.0:1790391175.555941:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.556004:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d97b231f going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.556214:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739328 00000100:00100000:1.0:1790391175.556220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739328 00000100:00100000:1.0:1790391175.556247:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391175.556253:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e36ddd03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+10:6711:x1877361130739328:12345-0@lo:502: 00000100:00100000:1.0:1790391175.556436:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e36ddd03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+10:6711:x1877361130739328:12345-0@lo:502: Request processed in 184us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.556443:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391175.556689:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6711:1877361130739328:0@lo:502: 00000040:00080000:2.0:1790391175.556726:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1790391175.556964:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1790391175.556985:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391175.556993:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a4f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.557003:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 000000001f6cf89a/0x35e94fc15449a4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391175.557044:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790391175.557046:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1790391175.557049:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790391175.557072:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000271c5e40/0x35e94fc15449a4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.557080:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000271c5e40/0x35e94fc15449a4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.557088:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000271c5e40/0x35e94fc15449a4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.557102:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f76c4006 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739456:0@lo:101: 00000100:00100000:0.0:1790391175.557132:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.557149:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078d7d894 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.557250:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739456 00000100:00100000:1.0:1790391175.557256:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739456 00000100:00100000:1.0:1790391175.557287:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391175.557294:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e696f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+10:5833:x1877361130739456:12345-0@lo:101: 00010000:00010000:1.0:1790391175.557398:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391175.557409:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000378df2e0/0x35e94fc15449a506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a4ff expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.557489:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000378df2e0/0x35e94fc15449a506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.557499:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000378df2e0/0x35e94fc15449a506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.557514:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000378df2e0, rc 0) 00000100:00100000:1.0:1790391175.557557:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e696f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130739456:12345-0@lo:101: Request processed in 264us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.557563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391175.558104:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f76c4006 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739456:0@lo:101: 00010000:00010000:0.0:1790391175.558120:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000271c5e40/0x35e94fc15449a4ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.558135:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000271c5e40/0x35e94fc15449a4ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.558186:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f76c4006 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739584:0@lo:501: 00000100:00100000:0.0:1790391175.558213:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.558437:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078d7d894 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.564080:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739584 00000100:00100000:2.0:1790391175.564098:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739584 00000100:00100000:2.0:1790391175.564162:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790391175.564170:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055f385b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130739584:12345-0@lo:501: 00000100:00100000:2.0:1790391175.564804:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055f385b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130739584:12345-0@lo:501: Request processed in 633us (6589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.564814:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391175.564942:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f76c4006 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739584:0@lo:501: 00000100:00100000:1.0:1790391175.565033:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd24efe9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739712:0@lo:503: 00000100:00100000:1.0:1790391175.565091:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.565126:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 000000007a2f2bf9 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.565276:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739712 00000100:00100000:2.0:1790391175.565281:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739712 00000100:00100000:3.0:1790391175.568653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391175.568674:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cb72e8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130739712:12345-0@lo:503: 00000100:00100000:3.0:1790391175.569159:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cb72e8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130739712:12345-0@lo:503: Request processed in 493us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391175.569177:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790391175.569868:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd24efe9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130739712:0@lo:503: 00000100:00100000:2.0:1790391175.574967:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6712:1877361130739840:0@lo:502: 00000100:00100000:2.0:1790391175.575070:0:6712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.575218:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739840 00000100:00100000:2.0:1790391175.575233:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739840 00000100:00100000:2.0:1790391175.575335:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391175.575344:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fcdca5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:6712:x1877361130739840:12345-0@lo:502: 00000100:00100000:2.0:1790391175.575833:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fcdca5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:6712:x1877361130739840:12345-0@lo:502: Request processed in 489us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.575842:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391175.579168:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bfb8106a going to sleep for 11 seconds 00000100:00100000:3.0:1790391175.579216:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c50203 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6712:1877361130739840:0@lo:502: 00000020:01000000:3.0:1790391175.579394:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790391175.579402:0:6712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790391175.579409:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391175.579411:0:6712:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790391175.579415:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790391175.579418:0:6712:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:3.0:1790391175.579442:0:6712:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790391175.579456:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391175.579473:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (0000000066c8abb8) 00000020:00000080:3.0:1790391175.579499:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:3.0:1790391175.579505:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790391175.579675:0:6712:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790391175.579743:0:6712:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790391175.579750:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449a514 00010000:00080000:3.0:1790391175.579786:0:6712:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3e813b8@lustre-OST0000-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:3.0:1790391175.580047:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1790391175.679330:0:6712:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790391175.679363:0:6712:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790391175.680227:0:6712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391175.680585:0:6712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391175.680793:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790391175.681257:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790391175.683434:0:6713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391175.683441:0:6713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1790391175.683792:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a9771e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+10:6691:x1877361130737920:12345-0@lo:253: Request processed in 215069us (215250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.683806:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:1.0:1790391175.684379:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391175.684391:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790391175.684424:0:6712:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790391175.684443:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449a51b 00000100:00080000:1.0:1790391175.684451:0:6712:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391175.684455:0:6712:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000d3e813b8 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1790391175.684486:0:6712:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003e61e6ae x1877361130739968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391175.684510:0:6712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790391175.684577:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391175.684581:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391175.684583:0:6712:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790391175.684586:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391175.684590:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391175.684591:0:6712:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391175.684594:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391175.684595:0:6712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790391175.684619:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6712:1877361130740096:0@lo:502: 00000100:00100000:1.0:1790391175.684671:0:6712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.684706:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740096 00000100:00100000:1.0:1790391175.684711:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740096 00000100:00100000:1.0:1790391175.684747:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391175.684754:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082896b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:6712:x1877361130740096:12345-0@lo:502: 00000100:00100000:1.0:1790391175.684964:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082896b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+10:6712:x1877361130740096:12345-0@lo:502: Request processed in 210us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.684970:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391175.685057:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3838638 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.685079:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6712:1877361130740096:0@lo:502: 00000020:01000000:1.0:1790391175.685102:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391175.685106:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391175.685107:0:6712:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790391175.685110:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1790391175.685166:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790391175.685180:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790391175.685187:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: 00000000271c5e40/0x35e94fc15449a4ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.685195:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: 00000000271c5e40/0x35e94fc15449a4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391175.685211:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391175.685213:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9624081bf000 from 1 10000000:01000000:1.0:1790391175.685216:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391175.685240:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 00000000fe716ef9/0x35e94fc15449a522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.685246:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: 00000000fe716ef9/0x35e94fc15449a522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.685254:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 00000000fe716ef9/0x35e94fc15449a522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.685264:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130740224:0@lo:101: 00000100:00100000:1.0:1790391175.685287:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.685304:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3838638 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.685318:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740224 00000100:00100000:1.0:1790391175.685321:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740224 00000100:00100000:1.0:1790391175.685340:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391175.685358:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ae8e938 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+10:5833:x1877361130740224:12345-0@lo:101: 00010000:00010000:1.0:1790391175.685367:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391175.685377:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a743331d/0x35e94fc15449a529 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a522 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.685396:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a743331d/0x35e94fc15449a529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a522 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.685405:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a743331d/0x35e94fc15449a529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a522 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.685425:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a743331d, rc 0) 00000100:00100000:1.0:1790391175.685453:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ae8e938 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130740224:12345-0@lo:101: Request processed in 108us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.685458:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391175.685487:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130740224:0@lo:101: 00010000:00010000:1.0:1790391175.685496:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 00000000fe716ef9/0x35e94fc15449a522 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.685504:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 00000000fe716ef9/0x35e94fc15449a522 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.685548:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130740352:0@lo:501: 00000100:00100000:1.0:1790391175.685571:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.685583:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3838638 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.685595:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740352 00000100:00100000:1.0:1790391175.685598:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740352 00000100:00100000:1.0:1790391175.685615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391175.685621:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000599cb8a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130740352:12345-0@lo:501: 00000100:00100000:1.0:1790391175.685815:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000599cb8a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130740352:12345-0@lo:501: Request processed in 194us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.685821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391175.685850:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130740352:0@lo:501: 00000100:00100000:1.0:1790391175.685869:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130740480:0@lo:503: 00000100:00100000:1.0:1790391175.685899:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.685910:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3838638 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.685924:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740480 00000100:00100000:1.0:1790391175.685927:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740480 00000100:00100000:1.0:1790391175.685945:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391175.685950:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfa5e2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130740480:12345-0@lo:503: 00000100:00100000:1.0:1790391175.686183:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfa5e2ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+11:5833:x1877361130740480:12345-0@lo:503: Request processed in 233us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.686189:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391175.686220:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abf0f7c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130740480:0@lo:503: 00000100:00100000:2.0:1790391175.686726:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e61e6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130739968:0@lo:8: 00000100:00100000:2.0:1790391175.686767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.686868:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130739968 00000100:00100000:3.0:1790391175.686874:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130739968 00000100:00100000:3.0:1790391175.686903:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391175.686907:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000192dbe23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1877361130739968:12345-0@lo:8: 00010000:00020000:3.0:1790391175.686922:0:6694:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391175.686958:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000192dbe23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1877361130739968:12345-0@lo:8: Request processed in 49us (191us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391175.686965:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790391175.687061:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000d3e813b8 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391175.687066:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391175.687076:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e61e6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130739968:0@lo:8: 00000100:00100000:0.0:1790391175.687565:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f07105ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130737920:0@lo:253: 10000000:01000000:0.0:1790391175.687578:0:6691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790391175.687581:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391175.687583:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391175.687584:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391175.687585:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1790391175.687587:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391175.687588:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391175.687589:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391175.687591:0:6691:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790391175.687592:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391175.687593:0:6691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790391175.687644:0:6691:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dd711e4b from lustre-OST0000 10000000:01000000:0.0:1790391175.687665:0:6691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790391175.687668:0:6691:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391175.687675:0:6691:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962427f099c0 local copy 10000000:01000000:0.0:1790391175.687679:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790391175.687711:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: 000000003b8ecf83/0x35e94fc15449a530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.687722:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.108@tcp lock: 000000003b8ecf83/0x35e94fc15449a530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.687731:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: 000000003b8ecf83/0x35e94fc15449a530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.687758:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f07105ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130740736:0@lo:101: 00000100:00100000:0.0:1790391175.687797:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.687817:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9787749 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.690396:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a2acf04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130740608:0@lo:400: 00000100:00100000:1.0:1790391175.690487:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.690487:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740736 00000100:00100000:0.0:1790391175.690498:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740736 00000100:00100000:0.0:1790391175.690549:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391175.690554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740608 00000100:00100000:1.0:1790391175.690558:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740608 00000100:00100000:0.0:1790391175.690558:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0b63820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:6691:x1877361130740736:12345-0@lo:101: 00010000:00010000:0.0:1790391175.690575:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790391175.690586:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391175.690591:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abf0f7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130740608:12345-0@lo:400: 00010000:00010000:0.0:1790391175.690595:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4a1541f/0x35e94fc15449a537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a530 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.690906:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4a1541f/0x35e94fc15449a537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a530 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.690919:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4a1541f/0x35e94fc15449a537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a530 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.690928:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4a1541f, rc 0) 00000100:00100000:2.0:1790391175.690948:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ec67048 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6715:1877361130740864:0@lo:502: 00000100:00100000:0.0:1790391175.690981:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0b63820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:6691:x1877361130740736:12345-0@lo:101: Request processed in 424us (3184us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391175.690988:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391175.690998:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.691064:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f07105ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130740736:0@lo:101: 00010000:00010000:3.0:1790391175.691082:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: 000000003b8ecf83/0x35e94fc15449a530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.691091:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: 000000003b8ecf83/0x35e94fc15449a530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391175.691201:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ef1b143 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130740992:0@lo:501: 00000100:00100000:3.0:1790391175.691229:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.695238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740864 00000100:00100000:0.0:1790391175.695253:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740864 00000100:00100000:0.0:1790391175.695309:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391175.695318:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3913040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:6715:x1877361130740864:12345-0@lo:502: 00000100:00100000:0.0:1790391175.695612:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3913040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:6715:x1877361130740864:12345-0@lo:502: Request processed in 295us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391175.695642:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391175.698686:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e41ebc84 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.698733:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ec67048 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6715:1877361130740864:0@lo:502: 00000020:01000000:2.0:1790391175.698800:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391175.698815:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391175.698817:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790391175.698827:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624081bf000 00000020:00000080:2.0:1790391175.698830:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790391175.698955:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6715:1877361130741120:0@lo:502: 00000100:00100000:2.0:1790391175.699045:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.699078:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391175.700453:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130741120 00000100:00100000:0.0:1790391175.700464:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130741120 00000100:00100000:0.0:1790391175.700540:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790391175.700550:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:6715:x1877361130741120:12345-0@lo:502: 00000100:00100000:0.0:1790391175.701150:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:6715:x1877361130741120:12345-0@lo:502: Request processed in 598us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391175.701161:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391175.701574:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391175.701787:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130740992 00000100:00100000:0.0:1790391175.701795:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130740992 00000100:00100000:2.0:1790391175.701819:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:6715:1877361130741120:0@lo:502: 00000100:00100000:0.0:1790391175.701826:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391175.701833:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:6691:x1877361130740992:12345-0@lo:501: 00000020:01000000:2.0:1790391175.701865:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391175.701872:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391175.701874:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790391175.701880:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790391175.701943:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790391175.701967:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391175.701979:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.701991:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391175.702003:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00100000:1.0:1790391175.704198:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130740608:12345-0@lo:400: Request processed in 13595us (13699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.704215:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790391175.704293:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96242d00f800 x1877361130740608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391175.704309:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130740608:0@lo:400: 00000100:00100000:0.0:1790391175.706413:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:6691:x1877361130740992:12345-0@lo:501: Request processed in 4570us (15172us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391175.706437:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790391175.709600:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130740992:0@lo:501: 10000000:01000000:3.0:1790391175.709741:0:6691:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790391175.709802:0:6691:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790391175.709812:0:6691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.709823:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.709844:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.709869:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391175.710098:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391175.710105:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.710112:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400030800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391175.710116:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.710130:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391175.710137:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391175.710143:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391175.710174:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.710181:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1790391175.710203:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962439f98800 00010000:00010000:1.0:1790391175.710206:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391175.710208:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790391175.710213:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff962427f099c0 10000000:01000000:3.0:1790391175.710217:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790391175.710220:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff962427f099c0 from 1 00010000:00010000:1.0:1790391175.710221:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962400030800/0x35e94fc15449a530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x35e94fc15449a537 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391175.710223:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790391175.710236:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391175.710238:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391175.710240:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391175.710244:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.710248:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1790391175.710251:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.710259:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.710261:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130741248:0@lo:103: 00000100:00100000:3.0:1790391175.710270:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741376:0@lo:101: 10000000:01000000:0.0:1790391175.710519:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962427f099c0 from 1 10000000:01000000:0.0:1790391175.710523:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790391175.710541:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.710548:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.710555:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.710565:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130741504:0@lo:101: 00000100:00100000:3.0:1790391175.710764:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.710808:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.711064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130741376 00000100:00100000:2.0:1790391175.711079:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130741376 00000100:00100000:2.0:1790391175.711134:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391175.711145:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:6691:x1877361130741376:12345-0@lo:101: 00010000:00010000:2.0:1790391175.711158:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391175.711171:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a0600/0x35e94fc15449a54c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a53e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.711191:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a0600/0x35e94fc15449a54c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a53e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.711201:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a0600/0x35e94fc15449a54c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a53e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.711218:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0600, rc 0) 00000100:00100000:2.0:1790391175.711257:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:6691:x1877361130741376:12345-0@lo:101: Request processed in 114us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.711263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391175.713104:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741376:0@lo:101: 00010000:00010000:3.0:1790391175.713130:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a54c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.713142:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a54c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391175.713184:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790391175.713190:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a54c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.713196:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a54c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391175.713203:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790391175.713208:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391175.713214:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790391175.713217:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790391175.713244:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.713251:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.713259:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391175.713275:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741632:0@lo:101: 00000100:00100000:3.0:1790391175.713475:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.713522:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.713810:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130741632 00000100:00100000:2.0:1790391175.713817:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130741632 00000100:00100000:2.0:1790391175.713868:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391175.713876:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+13:6691:x1877361130741632:12345-0@lo:101: 00010000:00010000:2.0:1790391175.713889:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391175.713902:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a553 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.713926:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a553 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.713935:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a553 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.713958:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a1a00, rc 0) 00000100:00100000:2.0:1790391175.714002:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130741632:12345-0@lo:101: Request processed in 126us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.714009:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790391175.714045:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741632:0@lo:101: 00010000:00010000:3.0:1790391175.714056:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.714064:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391175.714175:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741760:0@lo:501: 00000100:00100000:3.0:1790391175.714200:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.714232:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.714283:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130741760 00000100:00100000:2.0:1790391175.714288:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130741760 00000100:00100000:2.0:1790391175.714325:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391175.714331:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130741760:12345-0@lo:501: 00000100:00100000:2.0:1790391175.714928:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130741760:12345-0@lo:501: Request processed in 596us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.714935:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790391175.715054:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741760:0@lo:501: 00000100:00100000:3.0:1790391175.715084:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741888:0@lo:503: 00000100:00100000:3.0:1790391175.715122:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.715147:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.715220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130741888 00000100:00100000:2.0:1790391175.715225:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130741888 00000100:00100000:2.0:1790391175.715246:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790391175.715252:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130741888:12345-0@lo:503: 00000100:00100000:2.0:1790391175.715520:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130741888:12345-0@lo:503: Request processed in 268us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.715527:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790391175.715765:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130741888:0@lo:503: 00000040:00080000:3.0:1790391175.716064:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391175.716132:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742016:0@lo:502: 00000100:00100000:3.0:1790391175.716169:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.716188:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.716301:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742016 00000100:00100000:2.0:1790391175.716381:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742016 00000100:00100000:2.0:1790391175.716417:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391175.716432:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130742016:12345-0@lo:502: 00000100:00100000:2.0:1790391175.716573:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130742016:12345-0@lo:502: Request processed in 141us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.716579:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790391175.717360:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742016:0@lo:502: 00000100:00100000:1.0:1790391175.717795:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790391175.717899:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790391175.718052:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790391175.718095:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790391175.718154:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000100:00100000:2.0:1790391175.718183:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130741248 00000040:00080000:3.0:1790391175.718192:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000100:00100000:2.0:1790391175.718195:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130741248 00000040:00080000:3.0:1790391175.718223:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790391175.718257:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742144:0@lo:502: 00000100:00100000:2.0:1790391175.718294:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391175.718303:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+14:3309:x1877361130741248:12345-0@lo:103: 00000100:00100000:3.0:1790391175.718313:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391175.718313:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790391175.718328:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790391175.718330:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030200/0x35e94fc15449a537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a530 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.718353:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391175.718390:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+13:3309:x1877361130741248:12345-0@lo:103: Request processed in 89us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.718397:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391175.718419:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742144 00000100:00100000:2.0:1790391175.718423:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742144 00000100:00100000:2.0:1790391175.718446:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391175.718452:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:6691:x1877361130742144:12345-0@lo:502: 00000100:00100000:3.0:1790391175.718513:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130741248:0@lo:103: 00000100:00100000:2.0:1790391175.718601:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:6691:x1877361130742144:12345-0@lo:502: Request processed in 149us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391175.718601:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.718608:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391175.718779:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e0260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391175.718844:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742144:0@lo:502: 00000040:00080000:3.0:1790391175.718929:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790391175.719259:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:2.0:1790391175.723506:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130741504 00000100:00100000:2.0:1790391175.723519:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130741504 00000100:00100000:2.0:1790391175.723581:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391175.723591:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130741504:12345-0@lo:101: 00010000:00010000:2.0:1790391175.723606:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391175.723625:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a545 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.723651:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a545 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.723681:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a545 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.723691:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0200, rc 0) 00000100:00100000:2.0:1790391175.723770:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130741504:12345-0@lo:101: Request processed in 181us (5169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.723777:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790391175.723824:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130741504:0@lo:101: 00010000:00010000:0.0:1790391175.723842:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.723851:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391175.723919:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130742272:0@lo:501: 00000100:00100000:0.0:1790391175.723962:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.723987:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742272 00000100:00100000:1.0:1790391175.723991:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742272 00000100:00100000:0.0:1790391175.723992:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e0260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.724032:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790391175.724040:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130742272:12345-0@lo:501: 00000100:00100000:1.0:1790391175.724341:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130742272:12345-0@lo:501: Request processed in 302us (379us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391175.724366:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391175.724386:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130742272:0@lo:501: 10000000:01000000:0.0:1790391175.724408:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790391175.724423:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391175.724431:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1790391175.724585:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790391175.724593:0:6716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790391175.724599:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391175.724602:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790391175.724900:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391175.724917:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96241ffb8000) 00000020:00000080:3.0:1790391175.724935:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790391175.724941:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790391175.725095:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962439f98800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790391175.725102:0:6716:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790391175.725108:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x35e94fc15449a56f 00010000:00010000:0.0:1790391175.730162:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1790391175.730634:0:6716:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1790391175.736444:0:6716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790391175.737183:0:6716:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1790391175.747184:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790391175.747686:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790391175.750161:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790391175.750173:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391175.750179:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391175.750181:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790391175.750185:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391175.750190:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391175.750191:0:6716:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391175.750194:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391175.750196:0:6716:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790391175.750256:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391175.750260:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391175.750261:0:6716:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790391175.750264:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790391175.750514:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790391175.750538:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790391175.750560:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.750572:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391175.750580:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962439f98800 from 1 10000000:01000000:3.0:1790391175.750583:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391175.750629:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.750638:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.750648:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391175.750682:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742400:0@lo:101: 00000100:00100000:3.0:1790391175.750748:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.750836:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93180 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.753042:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742400 00000100:00100000:2.0:1790391175.753060:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742400 00000100:00100000:2.0:1790391175.753129:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391175.753139:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:6691:x1877361130742400:12345-0@lo:101: 00010000:00010000:2.0:1790391175.753154:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391175.753185:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a576 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.753221:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a576 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.753233:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a576 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.753243:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a1e00, rc 0) 00000100:00100000:2.0:1790391175.753328:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742400:12345-0@lo:101: Request processed in 191us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.753335:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790391175.763113:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742400:0@lo:101: 00010000:00010000:1.0:1790391175.763147:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.763162:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.763314:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742528:0@lo:501: 00000100:00100000:1.0:1790391175.763382:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391175.763437:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f7a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.763853:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742528 00000100:00100000:2.0:1790391175.763861:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742528 00000100:00100000:2.0:1790391175.763912:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391175.763923:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742528:12345-0@lo:501: 00000100:00100000:2.0:1790391175.764237:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742528:12345-0@lo:501: Request processed in 315us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.764245:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391175.764288:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742528:0@lo:501: 00000100:00100000:2.0:1790391175.764325:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742656:0@lo:503: 00000100:00100000:2.0:1790391175.764393:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.764422:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.764443:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742656 00000100:00100000:2.0:1790391175.764447:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742656 00000100:00100000:2.0:1790391175.764466:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790391175.764471:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742656:12345-0@lo:503: 00000100:00100000:2.0:1790391175.764614:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742656:12345-0@lo:503: Request processed in 142us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.764621:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790391175.764654:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742656:0@lo:503: 00000040:00080000:2.0:1790391175.764901:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391175.764955:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742784:0@lo:502: 00000100:00100000:2.0:1790391175.764986:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.765009:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.765042:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742784 00000100:00100000:2.0:1790391175.765046:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742784 00000100:00100000:2.0:1790391175.765063:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391175.765069:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742784:12345-0@lo:502: 00000100:00100000:2.0:1790391175.765191:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742784:12345-0@lo:502: Request processed in 121us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.765197:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391175.765224:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742784:0@lo:502: 00000040:00080000:2.0:1790391175.765475:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790391175.765519:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790391175.765542:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742912:0@lo:502: 00000100:00100000:2.0:1790391175.765573:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.765582:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.765602:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130742912 00000100:00100000:2.0:1790391175.765606:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130742912 00000100:00100000:2.0:1790391175.765622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790391175.765627:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742912:12345-0@lo:502: 00000100:00100000:2.0:1790391175.765733:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130742912:12345-0@lo:502: Request processed in 105us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.765739:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790391175.765770:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130742912:0@lo:502: 00000040:00080000:2.0:1790391175.765834:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790391175.765844:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790391175.770856:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391175.770869:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391175.770871:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790391175.770877:0:6720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962439f98800 00000020:00000080:2.0:1790391175.770880:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790391175.770898:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391175.770902:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391175.770904:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790391175.770907:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790391175.771994:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790391175.772051:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391175.772073:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.772087:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391175.772134:0:6691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790391175.772137:0:6691:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962439f98800 10000000:01000000:3.0:1790391175.772140:0:6691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962439f98800 10000000:01000000:3.0:1790391175.772144:0:6691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391175.772150:0:6691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962439f98800 from 1 10000000:01000000:3.0:1790391175.772152:0:6691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391175.772203:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.772212:0:6691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.772224:0:6691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391175.772250:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743040:0@lo:101: 00000100:00100000:3.0:1790391175.772330:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.772387:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.773289:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743040 00000100:00100000:1.0:1790391175.773309:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743040 00000100:00100000:1.0:1790391175.773366:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391175.773375:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130743040:12345-0@lo:101: 00010000:00010000:1.0:1790391175.773389:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391175.773423:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a584 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.773450:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.773462:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.773471:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31000, rc 0) 00000100:00100000:1.0:1790391175.773534:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743040:12345-0@lo:101: Request processed in 159us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.773541:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790391175.773816:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743040:0@lo:101: 00010000:00010000:3.0:1790391175.773832:0:6691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.773842:0:6691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391175.773941:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743168:0@lo:501: 00000100:00100000:3.0:1790391175.773978:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.774006:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391175.774224:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743168 00000100:00100000:0.0:1790391175.774230:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743168 00000100:00100000:0.0:1790391175.774266:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790391175.774274:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743168:12345-0@lo:501: 00000100:00100000:0.0:1790391175.774506:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743168:12345-0@lo:501: Request processed in 232us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391175.774522:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790391175.779273:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743168:0@lo:501: 00000100:00100000:3.0:1790391175.779366:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743296:0@lo:503: 00000100:00100000:3.0:1790391175.779451:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.779491:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.779577:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743296 00000100:00100000:1.0:1790391175.779584:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743296 00000100:00100000:1.0:1790391175.779650:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391175.779659:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743296:12345-0@lo:503: 00000100:00100000:1.0:1790391175.779864:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743296:12345-0@lo:503: Request processed in 204us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.779871:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391175.780307:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743296:0@lo:503: 00000040:00080000:0.0:1790391175.780605:0:6691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391175.780671:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743424:0@lo:502: 00000100:00100000:0.0:1790391175.780715:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.780796:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391175.782633:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743424 00000100:00100000:2.0:1790391175.782651:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743424 00000100:00100000:2.0:1790391175.782727:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391175.782738:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743424:12345-0@lo:502: 00000100:00100000:2.0:1790391175.783075:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743424:12345-0@lo:502: Request processed in 337us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.783083:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790391175.784167:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743424:0@lo:502: 00000040:00080000:0.0:1790391175.784623:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790391175.784687:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790391175.784724:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790391175.784774:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790391175.784812:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790391175.784864:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790391175.784902:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790391175.784936:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790391175.784986:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790391175.785087:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790391175.785124:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790391175.785190:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790391175.786604:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790391175.786660:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790391175.786728:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790391175.786765:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790391175.786799:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790391175.786846:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790391175.786880:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790391175.786912:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790391175.786976:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790391175.787030:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790391175.787077:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790391175.787125:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790391175.787164:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790391175.788112:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790391175.788200:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790391175.789394:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1790391175.789451:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743552:0@lo:502: 00000100:00100000:0.0:1790391175.789535:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.789582:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391175.789668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743552 00000100:00100000:3.0:1790391175.789676:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743552 00000100:00100000:3.0:1790391175.789725:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790391175.789735:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743552:12345-0@lo:502: 00000100:00100000:3.0:1790391175.789959:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743552:12345-0@lo:502: Request processed in 225us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391175.789966:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790391175.790090:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743552:0@lo:502: 00000040:00080000:0.0:1790391175.790163:0:6691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790391175.790584:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790391175.791422:0:6721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790391175.791437:0:6721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962427f43380) 00000020:00000080:0.0:1790391175.791459:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:0.0:1790391175.791542:0:6721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962439f98800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790391175.791547:0:6721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962439f98800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790391175.791549:0:6721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962439f98800 3 00010000:00080000:0.0:1790391175.791577:0:6721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96243a4bf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.108@tcp at head 00010000:00010000:0.0:1790391175.793659:0:6721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:0.0:1790391175.793854:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790391175.793887:0:6721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790391175.793912:0:6721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x35e94fc15449a599 00000100:00080000:0.0:1790391175.793923:0:6721:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391175.793929:0:6721:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96243a4bf800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391175.793974:0:6721:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962427f39c00 x1877361130743680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391175.794009:0:6721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790391175.794259:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1877361130743680:0@lo:38: 00000100:00100000:3.0:1790391175.794340:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391175.795452:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743680 00000100:00100000:0.0:1790391175.795468:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743680 00000100:00100000:0.0:1790391175.795511:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391175.795519:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1877361130743680:12345-0@lo:38: 00010000:00080000:0.0:1790391175.795543:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1790391175.795574:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x35e94fc15449a5a0 00000004:00100000:0.0:1790391175.795591:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391175.795621:0:5837:0:(import.c:65:import_set_state_nolock()) ffff96243f8ff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391175.795686:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877361130743680:12345-0@lo:38: Request processed in 167us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391175.795694:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790391175.795740:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962427f39c00 x1877361130743680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391175.795750:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391175.795759:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790391175.795767:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790391175.795772:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790391175.795774:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96243a4bf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790391175.795779:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1877361130743680:0@lo:38: 00000040:00080000:0.0:1790391175.796496:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1790391175.796805:0:6691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1790391175.796830:0:6691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391175.796853:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.796864:0:6691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790391175.796914:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790391175.796916:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391175.796918:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391175.796919:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391175.796921:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391175.796922:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391175.796924:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391175.796925:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391175.796927:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391175.796928:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391175.796930:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391175.796934:0:6691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1790391175.796937:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391175.796938:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391175.796939:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391175.796940:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391175.796941:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391175.796942:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391175.796943:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391175.796949:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391175.796950:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391175.796951:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391175.796952:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391175.796971:0:6691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790391175.796986:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743808:0@lo:253: 00000100:00100000:2.0:1790391175.797100:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.797141:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.797478:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743808 00000100:00100000:1.0:1790391175.797486:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743808 00000100:00100000:1.0:1790391175.797535:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391175.797546:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:6691:x1877361130743808:12345-0@lo:253: 20000000:01000000:1.0:1790391175.797573:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790391175.797589:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790391175.856814:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790391175.856834:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790391175.857008:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790391175.857034:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790391175.857059:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.857078:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e31e00/0x35e94fc15449a4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.857087:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.857127:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e31e00/0x35e94fc15449a4c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391175.857141:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962415e31e00/0x35e94fc15449a4c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 16 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391175.857156:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1877361130743936:0@lo:104: 00000100:00100000:2.0:1790391175.857226:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391175.857283:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391175.857356:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130743936 00000100:00100000:1.0:1790391175.857365:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130743936 00000100:00100000:1.0:1790391175.857414:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391175.857423:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5852:x1877361130743936:12345-0@lo:104: 00010000:00010000:1.0:1790391175.857449:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.857519:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391175.857526:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5852:x1877361130743936:12345-0@lo:104: Request processed in 104us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391175.857533:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790391175.857806:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391175.857814:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.857832:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8f800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1790391175.857836:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.857845:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391175.857853:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391175.857859:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391175.857893:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.857900:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391175.857920:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.857926:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a4c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a4c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.857941:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391175.857943:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391175.857945:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391175.858045:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130744064:0@lo:103: 00000100:00100000:1.0:1790391175.858079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391175.858156:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744064 00000100:00100000:3.0:1790391175.858162:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744064 00010000:00010000:3.0:1790391175.858181:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e31e00/0x35e94fc15449a4c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 17 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391175.858209:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391175.858224:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962408363450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+17:3307:x1877361130744064:12345-0@lo:103: 00010000:00010000:3.0:1790391175.858234:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391175.858239:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e31e00/0x35e94fc15449a4c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 17 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858249:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e31e00/0x35e94fc15449a4c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 17 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858264:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858272:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391175.858285:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003416367s 00010000:00010000:3.0:1790391175.858289:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858296:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858303:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858310:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858315:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391175.858319:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858327:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858350:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391175.858361:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391175.858398:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962408363450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+17:3307:x1877361130744064:12345-0@lo:103: Request processed in 175us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391175.858405:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391175.858483:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130744064:0@lo:103: 00010000:00010000:1.0:1790391175.859649:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e31e00/0x35e94fc15449a4c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a4c0 expref: 16 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391175.859664:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1877361130743936:0@lo:104: 00010000:00010000:1.0:1790391175.859687:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.859696:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.859703:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391175.859709:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a1800/0x35e94fc15449a5a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391175.875773:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:6691:x1877361130743808:12345-0@lo:253: Request processed in 78219us (78662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391175.875788:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790391175.875905:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:6691:1877361130743808:0@lo:253: 10000000:01000000:3.0:1790391175.875920:0:6691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790391175.875923:0:6691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790391175.875925:0:6691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790391175.875926:0:6691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391175.875927:0:6691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391175.875928:0:6691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391175.875929:0:6691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391175.875930:0:6691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391175.875932:0:6691:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391175.875933:0:6691:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391175.875935:0:6691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391175.875936:0:6691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790391175.875960:0:6691:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790391175.880577:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391175.880756:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391175.881058:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391175.881594:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391175.881780:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391175.882322:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790391175.883629:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790391176.156228:0:6691:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790391176.156235:0:6691:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790391176.156268:0:6691:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790391176.156463:0:6691:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790391176.156483:0:6691:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790391176.156514:0:6691:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1790391176.478325:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391177.500541:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391178.525419:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391179.545318:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391180.569173:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391181.214334:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391181.214353:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790391181.214356:0:38:0:(import.c:65:import_set_state_nolock()) ffff962439719000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391181.214364:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 211 00000100:00080000:0.0:1790391181.214369:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391181.214376:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962439719000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391181.214400:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962427f3b100 x1877361130744448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391181.214451:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130744192:0@lo:400: 00000100:00100000:0.0:1790391181.214519:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391181.214591:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130744320:0@lo:400: 00000100:00100000:0.0:1790391181.214620:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391181.214639:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391181.214644:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130744576:0@lo:400: 00000100:00100000:0.0:1790391181.214661:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391181.214686:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130744448:0@lo:8: 00000100:00100000:0.0:1790391181.214710:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391181.214738:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744192 00000100:00100000:0.0:1790391181.214745:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744192 00000100:00100000:0.0:1790391181.214782:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790391181.214791:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:3308:x1877361130744192:12345-0@lo:400: 00000100:00100000:0.0:1790391181.214835:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:3308:x1877361130744192:12345-0@lo:400: Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391181.214842:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391181.215277:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744448 00000100:00100000:2.0:1790391181.215283:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744448 00000100:00100000:2.0:1790391181.215301:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391181.215306:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1877361130744448:12345-0@lo:8: 00010000:00080000:2.0:1790391181.215328:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:2.0:1790391181.215353:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449a5ae 00002000:00100000:2.0:1790391181.215390:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96243f7ba800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790391181.215395:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1790391181.215398:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790391181.215514:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790391181.215645:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790391181.215666:0:6697:0:(import.c:65:import_set_state_nolock()) ffff96243f7bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391181.215710:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1877361130744448:12345-0@lo:8: Request processed in 403us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391181.215716:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391181.216421:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744320 00000100:00100000:0.0:1790391181.216428:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744320 00000100:00100000:0.0:1790391181.216504:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744576 00000100:00100000:0.0:1790391181.216514:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744576 00000100:00100000:3.0:1790391181.222058:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391181.222091:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130744320:12345-0@lo:400: 00000100:00100000:3.0:1790391181.222199:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130744320:12345-0@lo:400: Request processed in 127us (7576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391181.222206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391181.222231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391181.222250:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130744576:12345-0@lo:400: 00000100:00100000:3.0:1790391181.222291:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130744576:12345-0@lo:400: Request processed in 45us (7628us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391181.222297:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790391181.222316:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391181.222361:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f39500 x1877361130744576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391181.222376:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130744576:0@lo:400: 00010000:00080000:3.0:1790391181.222394:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f39880 x1877361130744320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391181.222403:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130744320:0@lo:400: 00000100:00100000:0.0:1790391181.222696:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130744192:0@lo:400: 00010000:00080000:0.0:1790391181.222724:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f3b100 x1877361130744448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391181.222733:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391181.222741:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790391181.222750:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790391181.222756:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790391181.222759:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962439719000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790391181.222782:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790391181.222787:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130744448:0@lo:8: 00000004:00080000:2.0:1790391181.225218:0:6713:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790391181.225591:0:6713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 216559574689ns, next at 0ns, rc = 0 00000004:00080000:2.0:1790391181.301217:0:6714:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790391181.301972:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d861500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130744832:0@lo:7: 00000100:00100000:2.0:1790391181.302063:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391181.302120:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026d80 going to sleep for 11 seconds 00000004:00080000:2.0:1790391181.302216:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1790391181.302330:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744832 00000100:00100000:2.0:1790391181.302338:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744832 00000100:00100000:2.0:1790391181.302391:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391181.302401:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1877361130744832:12345-0@lo:7: 00000100:00100000:0.0:1790391181.302533:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130744704:0@lo:13: 00000100:00100000:0.0:1790391181.302563:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790391181.303057:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391181.303166:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744704 00000100:00100000:1.0:1790391181.303176:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744704 00000100:00100000:1.0:1790391181.303206:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391181.303213:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130744704:12345-0@lo:13: 00002000:00000024:1.0:1790391181.303319:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790391181.303379:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130744704:12345-0@lo:13: Request processed in 166us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391181.303387:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790391181.303455:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d860e00 x1877361130744704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391181.303475:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130744704:0@lo:13: 00002000:00080000:2.0:1790391181.310090:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1790391181.310099:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790391181.310191:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1877361130744832:12345-0@lo:7: Request processed in 7786us (8122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391181.310201:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790391181.310601:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d861500 x1877361130744832/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391181.310617:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d861500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130744832:0@lo:7: 00000004:00080000:0.0:1790391181.310629:0:6714:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790391181.310665:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130744960:0@lo:5: 00000100:00100000:0.0:1790391181.310697:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391181.310738:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407deb000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391181.310972:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130744960 00000100:00100000:3.0:1790391181.310978:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130744960 00000100:00100000:3.0:1790391181.311049:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391181.311061:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6714:x1877361130744960:12345-0@lo:5: 00002000:00080000:3.0:1790391181.311085:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790391181.311089:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790391181.311415:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6714:x1877361130744960:12345-0@lo:5: Request processed in 357us (716us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790391181.311423:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790391181.311454:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f39c00 x1877361130744960/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391181.311466:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130744960:0@lo:5: 00000004:00080000:3.0:1790391181.311474:0:6714:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790391181.311731:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130745088:0@lo:700: 00000100:00100000:3.0:1790391181.311758:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391181.311876:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411abacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391181.311930:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745088 00000100:00100000:0.0:1790391181.311935:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745088 00000100:00100000:0.0:1790391181.312001:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391181.312008:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6714:x1877361130745088:12345-0@lo:700: 00000100:00100000:3.0:1790391181.312386:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1877361130745216:0@lo:700: 00000100:00100000:3.0:1790391181.312415:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391181.312446:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391181.312496:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745216 00000100:00100000:0.0:1790391181.312501:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745216 00000100:00100000:0.0:1790391181.312538:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391181.312546:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1877361130745216:12345-0@lo:700: 40000000:02000000:3.0:1790391181.329206:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1790391181.334506:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1877361130745216:12345-0@lo:700: Request processed in 21953us (22082us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391181.334525:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790391181.334534:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00c700 x1877361130745216/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790391197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391181.334548:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1877361130745216:0@lo:700: 40000000:02000000:0.0:1790391181.334561:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1790391181.387941:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6714:x1877361130745088:12345-0@lo:700: Request processed in 75926us (76175us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391181.387961:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:1.0:1790391181.388047:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790391181.388071:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:3.0:1790391181.395519:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00e300 x1877361130745088/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790391197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391181.395541:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130745088:0@lo:700: 00000004:02000040:3.0:1790391181.458922:0:6714:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1790391181.461688:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130745344:0@lo:5: 00000100:00100000:3.0:1790391181.461753:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391181.461806:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391181.461850:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745344 00000100:00100000:3.0:1790391181.461857:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745344 00000100:00100000:3.0:1790391181.461913:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391181.461923:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6714:x1877361130745344:12345-0@lo:5: 00002000:00080000:3.0:1790391181.471684:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790391181.471707:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1790391181.475333:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1877361130745344:12345-0@lo:5: Request processed in 13404us (13572us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790391181.475347:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790391181.475577:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00e300 x1877361130745344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391181.475591:0:6714:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790391181.475607:0:6714:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff96242d00e300 x1877361130745344/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391197 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391181.475618:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1877361130745344:0@lo:5: 00000004:00080000:1.0:1790391181.475631:0:6714:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1790391181.597636:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790391181.725642:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790391181.725650:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9624081bf000 from 4 10000000:01000000:1.0:1790391181.725656:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790391181.725703:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391181.725715:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391181.725740:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391181.725763:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130745472:0@lo:101: 00000100:00100000:1.0:1790391181.725832:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391181.725873:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745472 00000100:00100000:1.0:1790391181.725880:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745472 00000100:00100000:1.0:1790391181.725924:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790391181.725933:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130745472:12345-0@lo:101: 00010000:00010000:1.0:1790391181.725945:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391181.725957:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a5b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391181.725978:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391181.725989:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391181.725998:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30800, rc 0) 00000100:00100000:1.0:1790391181.726041:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130745472:12345-0@lo:101: Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391181.726048:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790391181.726093:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391181.726113:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130745472:0@lo:101: 00010000:00010000:1.0:1790391181.726125:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391181.726145:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391181.726185:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130745600:0@lo:256: 00000100:00100000:1.0:1790391181.726213:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391181.726232:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745600 00000100:00100000:1.0:1790391181.726236:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745600 00000100:00100000:1.0:1790391181.726267:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790391181.726274:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130745600:12345-0@lo:256: 20000000:01000000:1.0:1790391181.726286:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790391181.726300:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790391181.726303:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790391181.726366:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130745600:12345-0@lo:256: Request processed in 92us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391181.726372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790391181.726392:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391181.726403:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130745600:0@lo:256: 10000000:01000000:1.0:1790391181.726456:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790391181.726463:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391181.726471:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1790391182.488181:0:7068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790391182.617322:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391183.641812:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391184.666961:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391185.693742:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391186.334672:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130745728:0@lo:400: 00000100:00100000:0.0:1790391186.334740:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391186.334784:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391186.334790:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130746112:0@lo:400: 00000100:00100000:0.0:1790391186.334817:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391186.334846:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130745856:0@lo:400: 00000100:00100000:0.0:1790391186.334870:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391186.334888:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391186.334893:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130745984:0@lo:400: 00000100:00100000:0.0:1790391186.334918:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391186.334952:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130746112 00000100:00100000:0.0:1790391186.334960:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130746112 00000100:00100000:0.0:1790391186.335058:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745856 00000100:00100000:0.0:1790391186.335061:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745856 00000100:00100000:0.0:1790391186.335103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391186.335111:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130746112:12345-0@lo:400: 00000100:00100000:0.0:1790391186.335179:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130746112:12345-0@lo:400: Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391186.335187:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391186.335202:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391186.335208:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130745856:12345-0@lo:400: 00000100:00100000:0.0:1790391186.335237:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130745856:12345-0@lo:400: Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391186.335243:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391186.335266:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745984 00000100:00100000:0.0:1790391186.335270:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745984 00000100:00100000:0.0:1790391186.335294:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391186.335301:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877361130745984:12345-0@lo:400: 00000100:00100000:0.0:1790391186.335331:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877361130745984:12345-0@lo:400: Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391186.335336:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790391186.335350:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391186.335354:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790391186.335385:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f38700 x1877361130745984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391186.335399:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130745984:0@lo:400: 00010000:00080000:0.0:1790391186.335409:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f38a80 x1877361130745856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391186.335416:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130745856:0@lo:400: 00010000:00080000:0.0:1790391186.335441:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f3ad80 x1877361130746112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391186.335456:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130746112:0@lo:400: 00000100:00100000:1.0:1790391186.335645:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130745728 00000100:00100000:1.0:1790391186.335656:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130745728 00000100:00100000:1.0:1790391186.335683:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790391186.335689:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:3308:x1877361130745728:12345-0@lo:400: 00000100:00100000:1.0:1790391186.335726:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:3308:x1877361130745728:12345-0@lo:400: Request processed in 38us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391186.335731:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790391186.335759:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391186.335767:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130746240:0@lo:13: 00000100:00100000:1.0:1790391186.335788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391186.335815:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130746240 00000100:00100000:1.0:1790391186.335820:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130746240 00000100:00100000:1.0:1790391186.335839:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391186.335845:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130746240:12345-0@lo:13: 00002000:00000024:1.0:1790391186.335870:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391186.335904:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130746240:12345-0@lo:13: Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391186.335910:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790391186.335936:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d03c700 x1877361130746240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391186.335950:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130746240:0@lo:13: 00000100:00100000:0.0:1790391186.336880:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130745728:0@lo:400: 00010000:00010000:1.0:1790391186.723505:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790391186.945542:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790391187.737841:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391188.765289:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391189.788341:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391190.835882:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391191.453634:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391191.453659:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130746368:0@lo:13: 00000100:00100000:0.0:1790391191.453728:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391191.453799:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130746368 00000100:00100000:0.0:1790391191.453806:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130746368 00000100:00100000:0.0:1790391191.453858:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391191.453868:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130746368:12345-0@lo:13: 00002000:00000024:0.0:1790391191.453903:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391191.453949:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130746368:12345-0@lo:13: Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391191.453955:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790391191.453976:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391191.454003:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f38e00 x1877361130746368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391191.454132:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790391191.454235:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130746368:0@lo:13: 00000100:00100000:3.0:1790391191.464734:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391191.464758:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130746496:0@lo:400: 00000100:00100000:3.0:1790391191.464830:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391191.464877:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130746624:0@lo:400: 00000100:00100000:3.0:1790391191.464904:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391191.464927:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391191.464932:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130746752:0@lo:400: 00000100:00100000:3.0:1790391191.464953:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391191.464978:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130746496 00000100:00100000:3.0:1790391191.464984:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130746496 00000100:00100000:3.0:1790391191.465044:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391191.465053:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3309:x1877361130746496:12345-0@lo:400: 00000100:00100000:3.0:1790391191.465114:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3309:x1877361130746496:12345-0@lo:400: Request processed in 62us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391191.465122:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391191.465174:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130746496:0@lo:400: 00000100:00100000:0.0:1790391191.480103:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130746624 00000100:00100000:0.0:1790391191.480114:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130746624 00000100:00100000:0.0:1790391191.480171:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130746752 00000100:00100000:0.0:1790391191.480174:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130746752 00000100:00100000:0.0:1790391191.480205:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391191.480215:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130746624:12345-0@lo:400: 00000100:00100000:0.0:1790391191.480302:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130746624:12345-0@lo:400: Request processed in 89us (15396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391191.480315:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391191.480333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391191.480338:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130746752:12345-0@lo:400: 00000100:00100000:0.0:1790391191.480366:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130746752:12345-0@lo:400: Request processed in 28us (15412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391191.480372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790391191.480435:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00e680 x1877361130746752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391191.480451:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130746752:0@lo:400: 00010000:00080000:0.0:1790391191.480464:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00d500 x1877361130746624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391191.480473:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130746624:0@lo:400: 00000100:00080000:0.0:1790391191.480512:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391191.902821:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391192.921893:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391193.949972:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391194.970353:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391195.166454:0:7641:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790391195.166458:0:7641:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790391195.166598:0:7641:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96243f8f8000 00000020:01000004:0.0:1790391195.166615:0:7641:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1790391195.166700:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790391195.166715:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff962427f40000) 00000020:00000080:0.0:1790391195.166736:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790391195.179893:0:7641:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1790391195.180524:0:7641:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790391195.219297:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790391195.231995:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790391195.232066:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790391195.232120:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790391195.232156:0:7641:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790391195.232527:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790391195.232538:0:7641:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391195.232548:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x35e94fc15449a5ca 00000020:01000004:2.0:1790391195.232554:0:7641:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790391195.232574:0:7641:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391195.232577:0:7641:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391195.232583:0:7641:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790391195.232602:0:7641:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790391195.232606:0:7641:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790391195.262883:0:7641:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790391195.262920:0:7641:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.108@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790391195.262924:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790391195.262926:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391195.262927:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391195.262929:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391195.262930:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391195.262931:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391195.262932:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391195.262934:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391195.262935:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391195.262937:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391195.262938:0:7641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391195.262941:0:7641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790391195.262943:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391195.262944:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391195.262946:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391195.262946:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391195.262948:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391195.262949:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391195.262950:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391195.262951:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391195.262951:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391195.262953:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391195.262953:0:7641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391195.262979:0:7641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790391195.262997:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d861f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130746880:0@lo:253: 00000100:00100000:2.0:1790391195.263114:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391195.263171:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f7a1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391195.263329:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130746880 00000100:00100000:1.0:1790391195.263336:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130746880 00000100:00100000:1.0:1790391195.263394:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790391195.263404:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:7641:x1877361130746880:12345-0@lo:253: 20000000:01000000:1.0:1790391195.263430:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790391195.263434:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790391195.263438:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790391195.263442:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790391195.264378:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391195.264593:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790391195.264606:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790391195.264644:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790391195.264651:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790391195.264676:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790391195.264721:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790391195.265128:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790391195.265147:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:1.0:1790391195.265149:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:1.0:1790391195.265183:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790391195.265191:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790391195.265249:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790391195.265258:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:1.0:1790391195.265289:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790391195.265298:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790391195.265327:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790391195.265373:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790391195.266134:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790391195.266154:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.108@tcp 20000000:01000000:1.0:1790391195.266156:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.108@tcp (null) (null) (null) 00000040:00080000:1.0:1790391195.266191:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790391195.266198:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790391195.266228:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790391195.266235:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.108@tcp (null) (null) 00000040:00080000:1.0:1790391195.266277:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790391195.266286:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790391195.266345:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790391195.266383:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790391195.266398:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1790391195.266401:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1790391195.266407:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790391195.266408:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790391195.266410:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790391195.266423:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790391195.266425:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790391195.266455:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790391195.266458:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790391195.276410:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1790391195.276511:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1790391195.276542:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1790391195.277486:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1790391195.277540:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1790391195.277603:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1790391195.277619:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790391195.277621:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790391195.279552:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790391195.279798:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790391195.285896:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1790391195.286464:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1790391195.286510:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1790391195.286543:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1790391195.286556:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790391195.286559:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790391195.287943:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790391195.288429:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790391195.288471:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790391195.288538:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1790391195.288563:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790391195.288565:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790391195.294499:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1790391195.294657:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1790391195.294727:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1790391195.295499:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1790391195.295567:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1790391195.295660:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1790391195.295681:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790391195.295700:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295729:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a4f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295737:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e30200/0x35e94fc15449a506 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295743:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a553 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295750:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a545 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295756:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295763:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295802:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.295816:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.296267:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747008:0@lo:104: 00000100:00100000:3.0:1790391195.296390:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391195.296482:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a545 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.296491:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a545 expref: 16 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.296500:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747136:0@lo:104: 00010000:00010000:3.0:1790391195.296525:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a553 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.296533:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a553 expref: 16 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.296541:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747264:0@lo:104: 00010000:00010000:3.0:1790391195.296564:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e30200/0x35e94fc15449a506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.296572:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962415e30200/0x35e94fc15449a506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 16 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.296579:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747392:0@lo:104: 00010000:00010000:3.0:1790391195.296603:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.296609:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a4f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 16 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.296627:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747520:0@lo:104: 00000100:00100000:3.0:1790391195.296721:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391195.297182:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790391195.297203:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391195.297230:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391195.297240:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391195.297248:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391195.297261:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747008 00000100:00100000:2.0:1790391195.297268:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747008 00000100:00100000:2.0:1790391195.297387:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747136 00000100:00100000:2.0:1790391195.297391:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747136 00000100:00100000:2.0:1790391195.297402:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747264 00000100:00100000:2.0:1790391195.297405:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747264 00000100:00100000:2.0:1790391195.297413:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747392 00000100:00100000:2.0:1790391195.297416:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747392 00000100:00100000:2.0:1790391195.297424:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747520 00000100:00100000:2.0:1790391195.297426:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747520 00000100:00100000:2.0:1790391195.297437:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391195.297446:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407f20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+7:5831:x1877361130747008:12345-0@lo:104: 00010000:00010000:2.0:1790391195.297462:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.297595:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391195.297602:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407f20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+7:5831:x1877361130747008:12345-0@lo:104: Request processed in 157us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391195.297609:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391195.297654:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391195.297659:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d861180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+6:5831:x1877361130747136:12345-0@lo:104: 00010000:00010000:2.0:1790391195.297665:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.297750:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747008:0@lo:104: 00000100:00100000:3.0:1790391195.297759:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747136:0@lo:104: 00010000:00010000:0.0:1790391195.298431:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391195.298440:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298450:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8f000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391195.298454:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298463:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391195.298471:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391195.298478:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391195.298522:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298529:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391195.298564:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298572:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8f000/0x35e94fc15449a584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a58b expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298590:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391195.298593:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298614:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391195.298617:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298624:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391195.298631:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391195.298637:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391195.298651:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298657:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391195.298663:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298670:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a561 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.298681:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391195.298683:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391195.298685:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391195.298702:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130747776:0@lo:103: 00000100:00100000:0.0:1790391195.298872:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.298913:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391195.298919:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130747648:0@lo:103: 00000100:00100000:0.0:1790391195.298961:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.298995:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747776 00000100:00100000:0.0:1790391195.299001:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747776 00010000:00010000:0.0:1790391195.299057:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a545 expref: 17 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391195.299081:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747648 00000100:00100000:0.0:1790391195.299084:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747648 00010000:00010000:0.0:1790391195.299096:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a584 expref: 18 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391195.299107:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391195.299114:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+18:3310:x1877361130747776:12345-0@lo:103: 00010000:00010000:0.0:1790391195.299125:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391195.299131:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a545 expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.299141:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a545 expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.299157:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a0200/0x35e94fc15449a561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a545 expref: 18 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.299173:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391195.299204:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+17:3310:x1877361130747776:12345-0@lo:103: Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.299211:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391195.299227:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391195.299233:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3310:x1877361130747648:12345-0@lo:103: 00010000:00010000:0.0:1790391195.299241:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391195.299251:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.299262:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.299272:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e31000/0x35e94fc15449a58b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a584 expref: 16 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.299281:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391195.299303:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+15:3310:x1877361130747648:12345-0@lo:103: Request processed in 70us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.299309:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391195.299361:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130747648:0@lo:103: 00000100:00100000:0.0:1790391195.299370:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130747776:0@lo:103: 00010000:00010000:2.0:1790391195.301128:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1790391195.301141:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d861180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+6:5831:x1877361130747136:12345-0@lo:104: Request processed in 3479us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391195.301150:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391195.301184:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391195.301197:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+5:5831:x1877361130747264:12345-0@lo:104: 00010000:00010000:2.0:1790391195.301212:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.301415:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391195.301420:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+5:5831:x1877361130747264:12345-0@lo:104: Request processed in 231us (4190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391195.301426:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391195.301439:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391195.301445:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+4:5831:x1877361130747392:12345-0@lo:104: 00010000:00010000:2.0:1790391195.301453:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.301483:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391195.301487:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+4:5831:x1877361130747392:12345-0@lo:104: Request processed in 44us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391195.301492:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391195.301504:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391195.301510:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+3:5831:x1877361130747520:12345-0@lo:104: 00010000:00010000:2.0:1790391195.301518:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.301545:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1790391195.301545:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1790391195.301549:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+3:5831:x1877361130747520:12345-0@lo:104: Request processed in 41us (4301us total) trans 0 rc 0/0 00010000:00010000:0.0:1790391195.301552:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391195.301555:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790391195.301559:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8e600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391195.301563:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301571:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391195.301578:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391195.301584:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391195.301632:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301638:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391195.301656:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301663:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8e600/0x35e94fc15449a553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a55a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301677:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391195.301680:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301685:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391195.301688:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301694:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391195.301700:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391195.301705:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391195.301728:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301734:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391195.301740:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301756:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962400031a00/0x35e94fc15449a4ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301765:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391195.301768:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301774:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391195.301777:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301783:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391195.301790:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391195.301795:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391195.301819:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301826:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391195.301840:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.301846:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a4f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a4f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391195.302083:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130748032:0@lo:103: 00000100:00100000:1.0:1790391195.302124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391195.302161:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391195.302166:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130747904:0@lo:103: 00000100:00100000:1.0:1790391195.302185:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391195.302206:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391195.302254:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748032 00000100:00100000:2.0:1790391195.302261:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748032 00010000:00010000:2.0:1790391195.302282:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e30200/0x35e94fc15449a506 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 15 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391195.302329:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130747904 00000100:00100000:2.0:1790391195.302333:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130747904 00010000:00010000:2.0:1790391195.302345:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a553 expref: 16 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391195.302357:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391195.302364:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3308:x1877361130748032:12345-0@lo:103: 00010000:00010000:2.0:1790391195.302373:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391195.302378:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e30200/0x35e94fc15449a506 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 16 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.302387:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e30200/0x35e94fc15449a506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 16 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.302403:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391195.302431:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3308:x1877361130748032:12345-0@lo:103: Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391195.302438:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391195.302450:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391195.302455:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+15:3308:x1877361130747904:12345-0@lo:103: 00010000:00010000:2.0:1790391195.302463:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391195.302467:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a553 expref: 15 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.302476:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a553 expref: 15 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.302485:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391195.302512:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+15:3308:x1877361130747904:12345-0@lo:103: Request processed in 57us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391195.302518:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391195.302550:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130747904:0@lo:103: 00000100:00100000:2.0:1790391195.302558:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130748032:0@lo:103: 00000100:00100000:2.0:1790391195.303103:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130748160:0@lo:103: 00000100:00100000:2.0:1790391195.303136:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391195.303223:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391195.303225:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a1a00/0x35e94fc15449a55a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a553 expref: 14 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.303232:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391195.303234:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391195.303236:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747264:0@lo:104: 00010000:00010000:3.0:1790391195.303336:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e30200/0x35e94fc15449a506 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a4ff expref: 13 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.303348:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747392:0@lo:104: 00000100:00100000:3.0:1790391195.303360:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1877361130747520:0@lo:104: 00010000:00010000:3.0:1790391195.303400:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391195.303473:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748160 00000100:00100000:1.0:1790391195.303478:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748160 00010000:00010000:1.0:1790391195.303502:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a4f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 13 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391195.303572:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391195.303580:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+13:3309:x1877361130748160:12345-0@lo:103: 00010000:00010000:1.0:1790391195.303591:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391195.303596:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a4f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 13 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303606:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 13 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303618:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a4f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a4f1 expref: 13 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303649:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303658:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303672:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303679:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303686:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303693:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303708:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8f800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391195.303712:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303735:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303751:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.303761:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391195.303794:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+12:3309:x1877361130748160:12345-0@lo:103: Request processed in 215us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391195.303800:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1790391195.304119:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.304128:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.304135:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8f800/0x35e94fc15449a5d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391195.304150:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790391195.305095:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130748160:0@lo:103: 00000100:00100000:0.0:1790391195.363793:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+11:7641:x1877361130746880:12345-0@lo:253: Request processed in 100381us (100670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.363809:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391195.364105:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d861f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130746880:0@lo:253: 10000000:01000000:3.0:1790391195.364120:0:7641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790391195.364124:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790391195.364125:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790391195.364126:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391195.364127:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1790391195.364128:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391195.364130:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391195.364131:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391195.364133:0:7641:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790391195.364134:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391195.364135:0:7641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790391195.364157:0:7641:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96243f8f8000 from lustre-OST0001 10000000:01000000:3.0:1790391195.364182:0:7641:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790391195.364184:0:7641:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790391195.364192:0:7641:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962427f099c0 local copy 10000000:01000000:3.0:1790391195.364196:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790391195.364231:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.364241:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.364250:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.364267:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748288:0@lo:101: 00000100:00100000:3.0:1790391195.364382:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.364441:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391195.364511:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748288 00000100:00100000:1.0:1790391195.364517:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748288 00000100:00100000:1.0:1790391195.364555:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790391195.364565:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+11:7641:x1877361130748288:12345-0@lo:101: 00010000:00010000:1.0:1790391195.364577:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391195.364590:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e31e00/0x35e94fc15449a5df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a5d8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.364616:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e31e00/0x35e94fc15449a5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a5d8 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.364646:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e31e00/0x35e94fc15449a5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a5d8 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.364656:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31e00, rc 0) 00000100:00100000:1.0:1790391195.364707:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748288:12345-0@lo:101: Request processed in 144us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391195.364713:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391195.364929:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748288:0@lo:101: 00010000:00010000:3.0:1790391195.364946:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.364963:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.365103:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748416:0@lo:501: 00000100:00100000:3.0:1790391195.365128:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.365157:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.365219:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748416 00000100:00100000:0.0:1790391195.365224:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748416 00000100:00100000:0.0:1790391195.365256:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790391195.365263:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748416:12345-0@lo:501: 00000100:00100000:0.0:1790391195.365514:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748416:12345-0@lo:501: Request processed in 252us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391195.365521:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391195.365597:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748416:0@lo:501: 10000000:01000000:3.0:1790391195.365610:0:7641:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790391195.365657:0:7641:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790391195.365662:0:7641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.365671:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.365678:0:7641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.365702:0:7641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790391195.365720:0:7641:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96243f8f8000 10000000:01000000:3.0:1790391195.365725:0:7641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790391195.365730:0:7641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790391195.365732:0:7641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391195.365736:0:7641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790391195.365739:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790391195.365754:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.365771:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.365779:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.365791:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748544:0@lo:101: 00000100:00100000:3.0:1790391195.365814:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.365945:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bc00 going to sleep for 11 seconds 00010000:00010000:0.0:1790391195.366000:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391195.366006:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366040:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8f800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391195.366044:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366052:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391195.366059:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391195.366066:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391195.366085:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366101:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391195.366125:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366132:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8f800/0x35e94fc15449a5d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x35e94fc15449a5df expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366145:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391195.366147:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391195.366149:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391195.366158:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748544 00000100:00100000:0.0:1790391195.366162:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748544 00000100:00100000:0.0:1790391195.366185:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790391195.366191:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748544:12345-0@lo:101: 00010000:00010000:0.0:1790391195.366198:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391195.366207:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a5e6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366223:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366233:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366240:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031a00, rc 0) 00000100:00100000:0.0:1790391195.366266:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130748544:12345-0@lo:101: Request processed in 75us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.366272:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391195.366411:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130748672:0@lo:103: 00000100:00100000:3.0:1790391195.366438:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.366497:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748544:0@lo:101: 00010000:00010000:3.0:1790391195.366508:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.366516:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.366571:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748800:0@lo:501: 00000100:00100000:3.0:1790391195.366594:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.366605:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.366662:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748672 00000100:00100000:0.0:1790391195.366666:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748672 00000100:00100000:0.0:1790391195.366699:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391195.366706:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+13:3310:x1877361130748672:12345-0@lo:103: 00010000:00010000:0.0:1790391195.366713:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391195.366724:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e31e00/0x35e94fc15449a5df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a5d8 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.366733:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391195.366759:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+12:3310:x1877361130748672:12345-0@lo:103: Request processed in 53us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.366765:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391195.366781:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748800 00000100:00100000:0.0:1790391195.366784:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748800 00000100:00100000:0.0:1790391195.366800:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790391195.366806:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748800:12345-0@lo:501: 00000100:00100000:0.0:1790391195.367139:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748800:12345-0@lo:501: Request processed in 332us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.367145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391195.367226:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130748672:0@lo:103: 00000100:00100000:3.0:1790391195.367251:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748800:0@lo:501: 00000100:00100000:3.0:1790391195.367276:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748928:0@lo:503: 00000100:00100000:3.0:1790391195.367379:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.367412:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391195.367538:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130748928 00000100:00100000:1.0:1790391195.367543:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130748928 00000100:00100000:1.0:1790391195.367576:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391195.367584:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748928:12345-0@lo:503: 00000100:00100000:1.0:1790391195.367743:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130748928:12345-0@lo:503: Request processed in 159us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391195.367750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391195.367981:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130748928:0@lo:503: 00000040:00080000:3.0:1790391195.368393:0:7641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391195.368459:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749056:0@lo:502: 00000100:00100000:3.0:1790391195.368500:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.368525:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.368617:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749056 00000100:00100000:0.0:1790391195.368631:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749056 00000100:00100000:0.0:1790391195.368664:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790391195.368671:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130749056:12345-0@lo:502: 00000100:00100000:0.0:1790391195.368816:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130749056:12345-0@lo:502: Request processed in 146us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.368954:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391195.369159:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749056:0@lo:502: 00000040:00080000:3.0:1790391195.369477:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790391195.369533:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790391195.369572:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790391195.369740:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790391195.369785:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790391195.369968:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790391195.370004:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749184:0@lo:502: 00000100:00100000:3.0:1790391195.370188:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.370262:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.370442:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749184 00000100:00100000:0.0:1790391195.370449:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749184 00000100:00100000:0.0:1790391195.370499:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790391195.370507:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130749184:12345-0@lo:502: 00000100:00100000:0.0:1790391195.370980:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130749184:12345-0@lo:502: Request processed in 473us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.370989:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391195.371208:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749184:0@lo:502: 00000040:00080000:3.0:1790391195.371416:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790391195.371431:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790391195.372100:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391195.372110:0:7648:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790391195.372117:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391195.372120:0:7648:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790391195.372127:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391195.372144:0:7648:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff962427f419c0) 00000020:00000080:0.0:1790391195.372166:0:7648:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790391195.372173:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790391195.372244:0:7648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96243f8f8000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790391195.372252:0:7648:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790391195.372260:0:7648:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x35e94fc15449a5fb 00010000:00010000:1.0:1790391195.377283:0:7648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790391195.377756:0:7648:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790391195.380608:0:7648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790391195.381128:0:7648:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1790391195.384222:0:7648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1790391195.384607:0:7648:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790391195.386209:0:7648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790391195.386218:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391195.386224:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391195.386225:0:7648:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790391195.386228:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391195.386230:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391195.386231:0:7648:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391195.386233:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391195.386234:0:7648:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391195.386274:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391195.386276:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391195.386276:0:7648:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790391195.386279:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790391195.386456:0:7641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1790391195.386477:0:7641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790391195.386496:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.386504:0:7641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391195.386510:0:7641:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96243f8f8000 from 1 10000000:01000000:0.0:1790391195.386513:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391195.386549:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.386555:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.386574:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391195.386594:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749312:0@lo:101: 00000100:00100000:0.0:1790391195.386678:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.386709:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff962410e2f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.386727:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749312 00000100:00100000:0.0:1790391195.386733:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749312 00000100:00100000:0.0:1790391195.386774:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790391195.386783:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:7641:x1877361130749312:12345-0@lo:101: 00010000:00010000:0.0:1790391195.386794:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391195.386807:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a602 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.386934:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a602 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.386945:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a602 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.386954:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031c00, rc 0) 00000100:00100000:0.0:1790391195.386992:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749312:12345-0@lo:101: Request processed in 210us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.386998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790391195.387077:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749312:0@lo:101: 00010000:00010000:0.0:1790391195.387089:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.387108:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391195.387182:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749440:0@lo:501: 00000100:00100000:0.0:1790391195.387199:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.387216:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749440 00000100:00100000:0.0:1790391195.387219:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749440 00000100:00100000:0.0:1790391195.387232:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790391195.387236:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749440:12345-0@lo:501: 00000100:00100000:0.0:1790391195.387434:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749440:12345-0@lo:501: Request processed in 196us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.387439:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790391195.387456:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff962410e2f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.387464:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749440:0@lo:501: 00000100:00100000:0.0:1790391195.387481:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749568:0@lo:503: 00000100:00100000:0.0:1790391195.387505:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.387513:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408214540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.387521:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749568 00000100:00100000:0.0:1790391195.387523:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749568 00000100:00100000:0.0:1790391195.387536:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790391195.387539:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749568:12345-0@lo:503: 00000100:00100000:0.0:1790391195.388096:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749568:12345-0@lo:503: Request processed in 554us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.388102:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790391195.389968:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749568:0@lo:503: 00000040:00080000:3.0:1790391195.390266:0:7641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391195.390335:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749696:0@lo:502: 00000100:00100000:3.0:1790391195.390385:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.390410:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391195.390428:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749696 00000100:00100000:3.0:1790391195.390432:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749696 00000100:00100000:3.0:1790391195.390461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391195.390472:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749696:12345-0@lo:502: 00000100:00100000:3.0:1790391195.390615:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749696:12345-0@lo:502: Request processed in 142us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.390633:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391195.391116:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749696:0@lo:502: 00000040:00080000:3.0:1790391195.391364:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790391195.391415:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790391195.391440:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749824:0@lo:502: 00000100:00100000:3.0:1790391195.391475:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.391499:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391195.391513:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749824 00000100:00100000:3.0:1790391195.391517:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749824 00000100:00100000:3.0:1790391195.391541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391195.391548:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749824:12345-0@lo:502: 00000100:00100000:3.0:1790391195.391971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749824:12345-0@lo:502: Request processed in 423us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.391979:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391195.392051:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749824:0@lo:502: 00000040:00080000:3.0:1790391195.392141:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790391195.392152:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790391195.392516:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391195.392525:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391195.392527:0:7652:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790391195.392533:0:7652:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96243f8f8000 00000020:00000080:3.0:1790391195.392535:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391195.392552:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391195.392555:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391195.392562:0:7652:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790391195.392565:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790391195.392593:0:7641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790391195.392611:0:7641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391195.392804:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.392815:0:7641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391195.393415:0:7641:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790391195.393417:0:7641:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96243f8f8000 10000000:01000000:3.0:1790391195.393419:0:7641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96243f8f8000 10000000:01000000:3.0:1790391195.393423:0:7641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391195.393427:0:7641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96243f8f8000 from 1 10000000:01000000:3.0:1790391195.393429:0:7641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391195.393455:0:7641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.393461:0:7641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.393468:0:7641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.393480:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749952:0@lo:101: 00000100:00100000:3.0:1790391195.393518:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.393572:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391195.397374:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130749952 00000100:00100000:2.0:1790391195.397387:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130749952 00000100:00100000:2.0:1790391195.397457:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790391195.397466:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130749952:12345-0@lo:101: 00010000:00010000:2.0:1790391195.397479:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391195.397496:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a610 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.397526:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a610 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.397548:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a610 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.397557:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0200, rc 0) 00000100:00100000:2.0:1790391195.397713:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130749952:12345-0@lo:101: Request processed in 247us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391195.397720:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790391195.398275:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130749952:0@lo:101: 00010000:00010000:0.0:1790391195.398309:0:7641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.398318:0:7641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391195.398415:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750080:0@lo:501: 00000100:00100000:0.0:1790391195.398446:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.398764:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f7a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391195.400339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750080 00000100:00100000:3.0:1790391195.400348:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750080 00000100:00100000:3.0:1790391195.400387:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790391195.400398:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750080:12345-0@lo:501: 00000100:00100000:3.0:1790391195.400635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750080:12345-0@lo:501: Request processed in 237us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.400730:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790391195.400899:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750080:0@lo:501: 00000100:00100000:0.0:1790391195.400932:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750208:0@lo:503: 00000100:00100000:0.0:1790391195.400966:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.400997:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f7a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391195.401078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750208 00000100:00100000:3.0:1790391195.401081:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750208 00000100:00100000:3.0:1790391195.401106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790391195.401113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750208:12345-0@lo:503: 00000100:00100000:3.0:1790391195.401234:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750208:12345-0@lo:503: Request processed in 121us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.401238:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790391195.401286:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750208:0@lo:503: 00000040:00080000:0.0:1790391195.401570:0:7641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391195.401619:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750336:0@lo:502: 00000100:00100000:0.0:1790391195.401739:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.401755:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f7a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391195.401804:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750336 00000100:00100000:1.0:1790391195.401807:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750336 00000100:00100000:1.0:1790391195.401878:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790391195.401884:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750336:12345-0@lo:502: 00000100:00100000:1.0:1790391195.402045:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750336:12345-0@lo:502: Request processed in 161us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391195.402050:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790391195.402130:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750336:0@lo:502: 00000040:00080000:0.0:1790391195.402421:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790391195.402453:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790391195.402481:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790391195.402506:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790391195.402524:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790391195.402546:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790391195.402563:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790391195.402579:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790391195.402611:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790391195.402765:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790391195.402786:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790391195.402811:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790391195.402890:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790391195.402908:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790391195.402932:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790391195.402950:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790391195.402966:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790391195.403212:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790391195.403249:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790391195.403267:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790391195.403349:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790391195.403374:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790391195.403390:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790391195.403413:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790391195.403430:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790391195.403446:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790391195.403468:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790391195.403485:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1790391195.403500:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790391195.403521:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1790391195.403538:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1790391195.403554:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1790391195.403569:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1790391195.403591:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1790391195.403712:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1790391195.403748:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1790391195.403767:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1790391195.403798:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750464:0@lo:502: 00000100:00100000:0.0:1790391195.403905:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.403964:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f7a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391195.404007:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750464 00000100:00100000:1.0:1790391195.404196:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750464 00000100:00100000:1.0:1790391195.404255:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790391195.404260:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750464:12345-0@lo:502: 00000100:00100000:1.0:1790391195.404423:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130750464:12345-0@lo:502: Request processed in 163us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391195.404433:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790391195.404489:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130750464:0@lo:502: 00000040:00080000:0.0:1790391195.404548:0:7641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1790391195.404556:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790391195.405080:0:7653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790391195.405102:0:7653:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96243fa299c0) 00000020:00000080:0.0:1790391195.405124:0:7653:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1790391195.405185:0:7653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96243f8f8000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790391195.405188:0:7653:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96243f8f8000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790391195.405189:0:7653:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96243f8f8000 3 00010000:00080000:0.0:1790391195.405211:0:7653:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96243fa31800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.108@tcp at head 00010000:00010000:0.0:1790391195.406565:0:7653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790391195.406788:0:7653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790391195.406810:0:7653:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790391195.406872:0:7653:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x35e94fc15449a625 00000100:00080000:0.0:1790391195.406879:0:7653:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391195.406883:0:7653:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96243fa31800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391195.406919:0:7653:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962427f38a80 x1877361130750592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391195.406944:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130750592:0@lo:38: 00000100:00100000:0.0:1790391195.406997:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.407076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750592 00000100:00100000:0.0:1790391195.407081:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750592 00000100:00100000:0.0:1790391195.407107:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391195.407114:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1877361130750592:12345-0@lo:38: 00010000:00080000:0.0:1790391195.407137:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1790391195.407166:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x35e94fc15449a62c 00000004:00100000:0.0:1790391195.407177:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391195.407199:0:5836:0:(import.c:65:import_set_state_nolock()) ffff96243fa32000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391195.407236:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877361130750592:12345-0@lo:38: Request processed in 122us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.407241:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790391195.407267:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962427f38a80 x1877361130750592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391195.407274:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391195.407279:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1790391195.407283:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790391195.407286:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790391195.407392:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96243fa31800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790391195.407398:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130750592:0@lo:38: 00000100:00080000:0.0:1790391195.407412:0:7653:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790391195.407805:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130750720:0@lo:400: 00000100:00100000:3.0:1790391195.407890:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.407908:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391195.407912:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130750848:0@lo:400: 00000100:00100000:3.0:1790391195.407927:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.407944:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130750976:0@lo:400: 00000100:00100000:3.0:1790391195.407957:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.407978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750720 00000100:00100000:3.0:1790391195.407982:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750720 00000100:00100000:3.0:1790391195.408011:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750976 00000100:00100000:3.0:1790391195.408040:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750976 00000100:00100000:3.0:1790391195.408062:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391195.408066:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130750720:12345-0@lo:400: 00000100:00100000:3.0:1790391195.408098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130750720:12345-0@lo:400: Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.408105:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391195.408129:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391195.408135:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130750976:12345-0@lo:400: 00000100:00100000:3.0:1790391195.408159:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130750976:12345-0@lo:400: Request processed in 26us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.408163:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391195.408176:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130750848 00000100:00100000:3.0:1790391195.408178:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130750848 00000100:00100000:3.0:1790391195.408194:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391195.408198:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130750848:12345-0@lo:400: 00000100:00100000:3.0:1790391195.408215:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130750848:12345-0@lo:400: Request processed in 17us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.408218:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790391195.408229:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391195.408232:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391195.408244:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00c700 x1877361130750848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391195.408251:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130750848:0@lo:400: 00010000:00080000:3.0:1790391195.408258:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00fb80 x1877361130750720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391195.408263:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130750720:0@lo:400: 00010000:00080000:3.0:1790391195.408285:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00ce00 x1877361130750976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391195.408729:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130750976:0@lo:400: 00000040:00080000:0.0:1790391195.408975:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1790391195.409422:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7654:1877361130751104:0@lo:901: 00000100:00100000:3.0:1790391195.409461:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.409488:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408214540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391195.409524:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130751104 00000100:00100000:0.0:1790391195.409529:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130751104 00000100:00100000:0.0:1790391195.409563:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391195.409569:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1877361130751104:12345-0@lo:901: 00000100:00080000:3.0:1790391195.409727:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1790391195.411232:0:7641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1790391195.411265:0:7641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391195.411279:0:7641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391195.411297:0:7641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790391195.411341:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790391195.411343:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391195.411344:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391195.411345:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391195.411346:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391195.411347:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391195.411348:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391195.411349:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391195.411350:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391195.411351:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391195.411352:0:7641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391195.411356:0:7641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1790391195.411358:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391195.411358:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391195.411359:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391195.411360:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391195.411360:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391195.411364:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391195.411365:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391195.411365:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391195.411366:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391195.411366:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391195.411367:0:7641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391195.411385:0:7641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790391195.411395:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130751232:0@lo:253: 00000100:00100000:2.0:1790391195.411442:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391195.411467:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391195.411483:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130751232 00000100:00100000:2.0:1790391195.411488:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130751232 00000100:00100000:2.0:1790391195.411515:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790391195.411520:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:7641:x1877361130751232:12345-0@lo:253: 20000000:01000000:2.0:1790391195.411544:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790391195.411554:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790391195.422687:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1877361130751104:12345-0@lo:901: Request processed in 13108us (13216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391195.422702:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790391195.423077:0:7654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96242d00ce00 x1877361130751104/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790391211 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391195.423094:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00ce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7654:1877361130751104:0@lo:901: 20000000:01000000:3.0:1790391195.456124:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790391195.456144:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790391195.458103:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790391195.458113:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790391195.458132:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.458150:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.458176:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.458213:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391195.458228:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 14 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391195.458243:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1877361130751360:0@lo:104: 00000100:00100000:0.0:1790391195.458378:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391195.458434:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391195.458503:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130751360 00000100:00100000:1.0:1790391195.458510:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130751360 00000100:00100000:1.0:1790391195.458561:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391195.458571:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5852:x1877361130751360:12345-0@lo:104: 00010000:00010000:1.0:1790391195.458584:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.458725:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391195.458732:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:5852:x1877361130751360:12345-0@lo:104: Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391195.458739:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790391195.458762:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391195.458768:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.458775:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391195.458779:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.458787:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391195.458793:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391195.458798:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391195.458838:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.458854:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391195.458869:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.458875:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a5bc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391195.458891:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391195.458893:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391195.458895:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391195.459154:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130751488:0@lo:103: 00000100:00100000:3.0:1790391195.459190:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391195.459235:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130751488 00000100:00100000:3.0:1790391195.459240:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130751488 00010000:00010000:3.0:1790391195.459258:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 15 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.459282:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391195.459434:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962408362850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+15:3310:x1877361130751488:12345-0@lo:103: 00010000:00010000:3.0:1790391195.459447:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391195.459453:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 15 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459464:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 15 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459479:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459488:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391195.459500:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003416367s 00010000:00010000:3.0:1790391195.459510:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459516:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459522:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459527:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459532:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400030600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391195.459536:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459543:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459551:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459561:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391195.459592:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962408362850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+15:3310:x1877361130751488:12345-0@lo:103: Request processed in 303us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.459598:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391195.459915:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130751488:0@lo:103: 00010000:00010000:3.0:1790391195.459945:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e30800/0x35e94fc15449a5bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a5b5 expref: 14 pid: 5830 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.459957:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1877361130751360:0@lo:104: 00010000:00010000:3.0:1790391195.459976:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459985:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459991:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391195.459997:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030600/0x35e94fc15449a633 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391195.466265:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:7641:x1877361130751232:12345-0@lo:253: Request processed in 54733us (54810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391195.466283:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790391195.466388:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c86877e-0672-4feb-acd6-39a38006ba27:7641:1877361130751232:0@lo:253: 10000000:01000000:2.0:1790391195.466404:0:7641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790391195.466407:0:7641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391195.466408:0:7641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391195.466409:0:7641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391195.466410:0:7641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391195.466412:0:7641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391195.466413:0:7641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391195.466415:0:7641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391195.466417:0:7641:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391195.466418:0:7641:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391195.466420:0:7641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391195.466421:0:7641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790391195.466437:0:7641:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790391195.476924:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391195.477388:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391195.477573:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391195.478063:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391195.478274:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391195.478754:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790391195.480596:0:7641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790391195.922517:0:7641:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790391195.922525:0:7641:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790391195.922570:0:7641:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790391195.922957:0:7641:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790391195.922975:0:7641:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790391195.923007:0:7641:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790391195.996484:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391196.573353:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130751616:0@lo:13: 00000100:00100000:3.0:1790391196.573420:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391196.573869:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130751616 00000100:00100000:0.0:1790391196.573877:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130751616 00000100:00100000:0.0:1790391196.573929:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391196.573938:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130751616:12345-0@lo:13: 00002000:00000024:0.0:1790391196.574150:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391196.574958:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130751616:12345-0@lo:13: Request processed in 1008us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391196.574967:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790391196.577562:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d00d880 x1877361130751616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391196.577594:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130751616:0@lo:13: 00010000:00010000:1.0:1790391197.021849:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391198.053602:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391199.072978:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391200.090323:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391200.668419:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130751744:0@lo:400: 00000100:00100000:0.0:1790391200.668501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391200.668567:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130752256:0@lo:400: 00000100:00100000:0.0:1790391200.668592:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391200.668617:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391200.668624:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130752128:0@lo:400: 00000100:00100000:0.0:1790391200.668655:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391200.668686:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130751872:0@lo:400: 00000100:00100000:0.0:1790391200.668709:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391200.668725:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391200.668741:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130752000:0@lo:400: 00000100:00100000:0.0:1790391200.668764:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391200.668795:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752256 00000100:00100000:0.0:1790391200.668803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752256 00000100:00100000:0.0:1790391200.668844:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752128 00000100:00100000:0.0:1790391200.668847:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752128 00000100:00100000:0.0:1790391200.668859:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130751872 00000100:00100000:0.0:1790391200.668861:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130751872 00000100:00100000:0.0:1790391200.668874:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391200.668883:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130752256:12345-0@lo:400: 00000100:00100000:0.0:1790391200.668929:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130752256:12345-0@lo:400: Request processed in 46us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391200.668959:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391200.668976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391200.668981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130752128:12345-0@lo:400: 00000100:00100000:0.0:1790391200.669008:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130752128:12345-0@lo:400: Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391200.669043:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391200.669056:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391200.669061:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130751872:12345-0@lo:400: 00000100:00100000:0.0:1790391200.669093:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130751872:12345-0@lo:400: Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391200.669099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1790391200.669122:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790391200.669148:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f38a80 x1877361130751872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391200.669162:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130751872:0@lo:400: 00010000:00080000:0.0:1790391200.669188:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f39880 x1877361130752128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391200.669196:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130752128:0@lo:400: 00010000:00080000:0.0:1790391200.669205:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f38e00 x1877361130752256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391200.669214:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130752256:0@lo:400: 00000100:00100000:0.0:1790391200.669243:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752000 00000100:00100000:0.0:1790391200.669246:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752000 00000100:00100000:0.0:1790391200.669276:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391200.669282:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130752000:12345-0@lo:400: 00000100:00100000:0.0:1790391200.669315:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130752000:12345-0@lo:400: Request processed in 34us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391200.669321:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790391200.669337:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391200.669358:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f38700 x1877361130752000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391200.669367:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130752000:0@lo:400: 00000100:00100000:1.0:1790391200.669834:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130751744 00000100:00100000:1.0:1790391200.669839:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130751744 00000100:00100000:1.0:1790391200.669867:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790391200.669874:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+13:3308:x1877361130751744:12345-0@lo:400: 00000100:00100000:1.0:1790391200.669917:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+13:3308:x1877361130751744:12345-0@lo:400: Request processed in 44us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391200.669923:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790391200.671308:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130751744:0@lo:400: 00010000:00010000:1.0:1790391201.115246:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391201.692049:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130752384:0@lo:13: 00000100:00100000:0.0:1790391201.692115:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391201.692190:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752384 00000100:00100000:0.0:1790391201.692198:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752384 00000100:00100000:0.0:1790391201.692253:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391201.692262:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130752384:12345-0@lo:13: 00002000:00000024:0.0:1790391201.692297:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391201.692337:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130752384:12345-0@lo:13: Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391201.692344:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790391201.692383:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa71500 x1877361130752384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391201.692404:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130752384:0@lo:13: 00010000:00010000:0.0:1790391202.145354:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790391203.141003:0:7996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790391203.161293:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391204.186964:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790391204.761177:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391204.761186:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962439f98800 from 30 10000000:01000000:1.0:1790391204.761192:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391204.761238:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.761250:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.761273:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.761297:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130752512:0@lo:101: 00000100:00100000:1.0:1790391204.761377:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.761467:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391204.766132:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752512 00000100:00100000:0.0:1790391204.766146:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752512 00000100:00100000:0.0:1790391204.766194:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391204.766204:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130752512:12345-0@lo:101: 00010000:00010000:0.0:1790391204.766220:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391204.766236:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a63a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391204.766273:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a63a expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391204.766284:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a63a expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391204.766293:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030400, rc 0) 00000100:00100000:0.0:1790391204.766365:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130752512:12345-0@lo:101: Request processed in 161us (4987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391204.766372:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790391204.766509:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130752512:0@lo:101: 00010000:00010000:1.0:1790391204.766527:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.766537:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.766602:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130752640:0@lo:501: 00000100:00100000:1.0:1790391204.766644:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.766682:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391204.766959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752640 00000100:00100000:0.0:1790391204.766965:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752640 00000100:00100000:0.0:1790391204.767939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790391204.767953:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130752640:12345-0@lo:501: 00000100:00100000:0.0:1790391204.768333:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130752640:12345-0@lo:501: Request processed in 384us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391204.768342:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790391204.768459:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130752640:0@lo:501: 00000100:00100000:1.0:1790391204.768504:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130752768:0@lo:503: 00000100:00100000:1.0:1790391204.768552:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.771721:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.776122:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752768 00000100:00100000:3.0:1790391204.776138:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752768 00000100:00100000:3.0:1790391204.776193:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790391204.776204:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130752768:12345-0@lo:503: 00000100:00100000:3.0:1790391204.776591:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130752768:12345-0@lo:503: Request processed in 388us (8037us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.776609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790391204.776682:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130752768:0@lo:503: 00000100:00100000:3.0:1790391204.776889:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8078:1877361130752896:0@lo:502: 00000100:00100000:3.0:1790391204.776931:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.776955:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130752896 00000100:00100000:3.0:1790391204.776959:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130752896 00000100:00100000:3.0:1790391204.776979:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790391204.776986:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:8078:x1877361130752896:12345-0@lo:502: 00000100:00100000:3.0:1790391204.777210:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:8078:x1877361130752896:12345-0@lo:502: Request processed in 224us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.777217:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790391204.777256:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.777270:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8078:1877361130752896:0@lo:502: 00000100:00100000:3.0:1790391204.777309:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8078:1877361130753024:0@lo:502: 00000100:00100000:3.0:1790391204.777342:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.777361:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753024 00000100:00100000:3.0:1790391204.777365:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753024 00000100:00100000:3.0:1790391204.777381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790391204.777387:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:8078:x1877361130753024:12345-0@lo:502: 00000100:00100000:3.0:1790391204.777498:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:8078:x1877361130753024:12345-0@lo:502: Request processed in 110us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.777504:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790391204.777541:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.777553:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8078:1877361130753024:0@lo:502: 00000040:00080000:3.0:1790391204.777578:0:8078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790391204.777621:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790391204.777637:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790391204.777647:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.777658:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391204.777667:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790391204.777669:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790391204.777672:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790391204.777693:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.777700:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.777708:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391204.777719:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753152:0@lo:101: 00000100:00100000:3.0:1790391204.777745:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.777756:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.777767:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753152 00000100:00100000:3.0:1790391204.777770:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753152 00000100:00100000:3.0:1790391204.777786:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391204.777791:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130753152:12345-0@lo:101: 00010000:00010000:3.0:1790391204.777798:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391204.777816:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.777836:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a648 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.777845:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a648 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.777852:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412d8fc00, rc 0) 00000100:00100000:3.0:1790391204.777895:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130753152:12345-0@lo:101: Request processed in 103us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.777900:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391204.777928:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753152:0@lo:101: 00010000:00010000:3.0:1790391204.777939:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.777947:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391204.777981:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753280:0@lo:501: 00000100:00100000:3.0:1790391204.778003:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.778035:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.778047:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753280 00000100:00100000:3.0:1790391204.778050:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753280 00000100:00100000:3.0:1790391204.778068:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790391204.778073:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130753280:12345-0@lo:501: 00000100:00100000:3.0:1790391204.778267:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130753280:12345-0@lo:501: Request processed in 193us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.778283:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790391204.778312:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753280:0@lo:501: 00000100:00100000:3.0:1790391204.778336:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753408:0@lo:503: 00000100:00100000:3.0:1790391204.778368:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.778380:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.778391:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753408 00000100:00100000:3.0:1790391204.778393:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753408 00000100:00100000:3.0:1790391204.778409:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790391204.778414:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130753408:12345-0@lo:503: 00000100:00100000:3.0:1790391204.778665:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130753408:12345-0@lo:503: Request processed in 250us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.778672:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790391204.778709:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753408:0@lo:503: 00000100:00100000:0.0:1790391204.779759:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8079:1877361130753536:0@lo:502: 00000100:00100000:0.0:1790391204.779814:0:8079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391204.779856:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391204.779980:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753536 00000100:00100000:1.0:1790391204.779987:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753536 00000100:00100000:1.0:1790391204.780050:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790391204.780059:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:8079:x1877361130753536:12345-0@lo:502: 00000100:00100000:1.0:1790391204.780288:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:8079:x1877361130753536:12345-0@lo:502: Request processed in 230us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391204.780301:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790391204.780404:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8079:1877361130753536:0@lo:502: 00000020:01000000:3.0:1790391204.780432:0:8079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391204.780441:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391204.780443:0:8079:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790391204.780448:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790391204.780450:0:8079:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790391204.780470:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8079:1877361130753664:0@lo:502: 00000100:00100000:3.0:1790391204.780505:0:8079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.780526:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391204.780569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753664 00000100:00100000:1.0:1790391204.780573:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753664 00000100:00100000:1.0:1790391204.780593:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790391204.780599:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:8079:x1877361130753664:12345-0@lo:502: 00000100:00100000:1.0:1790391204.780707:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:8079:x1877361130753664:12345-0@lo:502: Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391204.780713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790391204.780826:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8079:1877361130753664:0@lo:502: 00000020:01000000:3.0:1790391204.780845:0:8079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391204.780849:0:8079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391204.780854:0:8079:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790391204.780858:0:8079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790391204.780995:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790391204.782011:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790391204.782041:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.782053:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391204.782062:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391204.782065:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9624081bf000 from 30 10000000:01000000:1.0:1790391204.782068:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391204.782100:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.782108:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.782118:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.782137:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753792:0@lo:101: 00000100:00100000:1.0:1790391204.782193:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.782218:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391204.782288:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753792 00000100:00100000:0.0:1790391204.782296:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753792 00000100:00100000:0.0:1790391204.782338:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790391204.782346:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130753792:12345-0@lo:101: 00010000:00010000:0.0:1790391204.782358:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391204.782371:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a656 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391204.782400:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a656 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391204.782412:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a656 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391204.782422:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030800, rc 0) 00000100:00100000:0.0:1790391204.782456:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130753792:12345-0@lo:101: Request processed in 111us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391204.782462:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391204.783597:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753792:0@lo:101: 00010000:00010000:1.0:1790391204.783618:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.783629:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.783686:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753920:0@lo:501: 00000100:00100000:1.0:1790391204.783724:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.783746:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391204.783945:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130753920 00000100:00100000:2.0:1790391204.783951:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130753920 00000100:00100000:2.0:1790391204.783996:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790391204.784005:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130753920:12345-0@lo:501: 00000100:00100000:2.0:1790391204.784269:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130753920:12345-0@lo:501: Request processed in 265us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391204.784276:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790391204.784436:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130753920:0@lo:501: 00000100:00100000:1.0:1790391204.784467:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754048:0@lo:503: 00000100:00100000:1.0:1790391204.784508:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.784536:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391204.784577:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754048 00000100:00100000:2.0:1790391204.784581:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754048 00000100:00100000:2.0:1790391204.784646:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790391204.784654:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130754048:12345-0@lo:503: 00000100:00100000:2.0:1790391204.784796:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130754048:12345-0@lo:503: Request processed in 143us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391204.784803:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790391204.784861:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754048:0@lo:503: 00000100:00100000:1.0:1790391204.785070:0:8081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8081:1877361130754176:0@lo:502: 00000100:00100000:1.0:1790391204.785106:0:8081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.788915:0:8081:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391204.788984:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754176 00000100:00100000:0.0:1790391204.788994:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754176 00000100:00100000:0.0:1790391204.789157:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790391204.789167:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:8081:x1877361130754176:12345-0@lo:502: 00000100:00100000:0.0:1790391204.789472:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:8081:x1877361130754176:12345-0@lo:502: Request processed in 306us (4365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391204.789480:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790391204.789679:0:8081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8081:1877361130754176:0@lo:502: 00000100:00100000:1.0:1790391204.789745:0:8081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8081:1877361130754304:0@lo:502: 00000100:00100000:1.0:1790391204.789787:0:8081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.789814:0:8081:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391204.789852:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754304 00000100:00100000:0.0:1790391204.789856:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754304 00000100:00100000:0.0:1790391204.789927:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790391204.789935:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:8081:x1877361130754304:12345-0@lo:502: 00000100:00100000:0.0:1790391204.790100:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:8081:x1877361130754304:12345-0@lo:502: Request processed in 166us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391204.790106:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790391204.790170:0:8081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8081:1877361130754304:0@lo:502: 00000040:00080000:1.0:1790391204.790196:0:8081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790391204.790254:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790391204.790269:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391204.790280:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.790290:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391204.790299:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790391204.790302:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9624081bf000 from 5 10000000:01000000:1.0:1790391204.790305:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790391204.790328:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.790337:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.790346:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.790359:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754432:0@lo:101: 00000100:00100000:1.0:1790391204.790385:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.790526:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.790627:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754432 00000100:00100000:3.0:1790391204.790633:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754432 00000100:00100000:3.0:1790391204.790661:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790391204.790668:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130754432:12345-0@lo:101: 00010000:00010000:3.0:1790391204.790677:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391204.790690:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412d8f800/0x35e94fc15449a66b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a664 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.790710:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8f800/0x35e94fc15449a66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a664 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.790720:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412d8f800/0x35e94fc15449a66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a664 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.790728:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412d8f800, rc 0) 00000100:00100000:3.0:1790391204.790768:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130754432:12345-0@lo:101: Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.790774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391204.791702:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754432:0@lo:101: 00010000:00010000:1.0:1790391204.791719:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.791730:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.791791:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754560:0@lo:256: 00000100:00100000:1.0:1790391204.791832:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.791860:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.791914:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754560 00000100:00100000:3.0:1790391204.791920:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754560 00000100:00100000:3.0:1790391204.791949:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790391204.791955:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130754560:12345-0@lo:256: 20000000:01000000:3.0:1790391204.791971:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790391204.791989:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790391204.791992:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790391204.792096:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130754560:12345-0@lo:256: Request processed in 140us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.792103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790391204.792179:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754560:0@lo:256: 10000000:01000000:1.0:1790391204.792225:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790391204.792232:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.792239:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391204.792246:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790391204.792249:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1790391204.792252:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790391204.792272:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.792279:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.792286:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.792297:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754688:0@lo:101: 00000100:00100000:1.0:1790391204.792321:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.792343:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.792382:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754688 00000100:00100000:3.0:1790391204.792387:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754688 00000100:00100000:3.0:1790391204.792403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790391204.792409:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130754688:12345-0@lo:101: 00010000:00010000:3.0:1790391204.792417:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391204.792427:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a672 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.792442:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a672 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.792450:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a672 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.792457:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412d8e600, rc 0) 00000100:00100000:3.0:1790391204.792527:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130754688:12345-0@lo:101: Request processed in 117us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.792533:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391204.792995:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754688:0@lo:101: 00010000:00010000:1.0:1790391204.793193:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.793202:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.793249:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754816:0@lo:501: 00000100:00100000:1.0:1790391204.793278:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.793305:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391204.793596:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754816 00000100:00100000:2.0:1790391204.793601:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754816 00000100:00100000:2.0:1790391204.793629:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790391204.793638:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130754816:12345-0@lo:501: 00000100:00100000:2.0:1790391204.793884:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130754816:12345-0@lo:501: Request processed in 247us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391204.793892:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790391204.793964:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754816:0@lo:501: 00000100:00100000:1.0:1790391204.793991:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754944:0@lo:503: 00000100:00100000:1.0:1790391204.794058:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.794080:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f934000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391204.794094:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130754944 00000100:00100000:1.0:1790391204.794098:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130754944 00000100:00100000:1.0:1790391204.794116:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391204.794123:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130754944:12345-0@lo:503: 00000100:00100000:1.0:1790391204.794401:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130754944:12345-0@lo:503: Request processed in 278us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391204.794408:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391204.794448:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130754944:0@lo:503: 00000100:00100000:1.0:1790391204.794612:0:8082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8082:1877361130755072:0@lo:502: 00000100:00100000:1.0:1790391204.794646:0:8082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.794666:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755072 00000100:00100000:1.0:1790391204.794670:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755072 00000100:00100000:1.0:1790391204.794687:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790391204.794700:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8082:x1877361130755072:12345-0@lo:502: 00000100:00100000:1.0:1790391204.794908:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8082:x1877361130755072:12345-0@lo:502: Request processed in 209us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391204.794915:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790391204.794944:0:8082:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f9349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391204.794956:0:8082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8082:1877361130755072:0@lo:502: 00000020:01000000:1.0:1790391204.794977:0:8082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790391204.794984:0:8082:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790391204.794992:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391204.794995:0:8082:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790391204.795002:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790391204.795006:0:8082:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:1.0:1790391204.795047:0:8082:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790391204.795051:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391204.795065:0:8082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96243a7fb380) 00000020:00000080:1.0:1790391204.795085:0:8082:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790391204.795091:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790391204.795152:0:8082:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790391204.795157:0:8082:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790391204.795165:0:8082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449a687 00010000:00080000:1.0:1790391204.795194:0:8082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962439f99800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:1.0:1790391204.795416:0:8082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1790391204.795707:0:8082:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790391204.795717:0:8082:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790391204.796255:0:8082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391204.796477:0:8082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391204.796528:0:8082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1790391204.796590:0:8082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1790391204.797408:0:8083:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391204.797413:0:8083:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790391204.798061:0:8082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391204.798095:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790391204.798127:0:8082:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790391204.798148:0:8082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449a68e 00000100:00080000:0.0:1790391204.798158:0:8082:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391204.798164:0:8082:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962439f99800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391204.798196:0:8082:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96243fa71f80 x1877361130755200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391204.798220:0:8082:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790391204.798271:0:8082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391204.798275:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391204.798277:0:8082:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790391204.798280:0:8082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391204.798285:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391204.798286:0:8082:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790391204.798289:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790391204.798290:0:8082:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790391204.798317:0:8082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8082:1877361130755328:0@lo:502: 00000100:00100000:0.0:1790391204.798395:0:8082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391204.798426:0:8082:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.798569:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130755840:0@lo:400: 00000100:00100000:3.0:1790391204.798601:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.798624:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391204.798629:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130755456:0@lo:400: 00000100:00100000:3.0:1790391204.798650:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.798674:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130755584:0@lo:400: 00000100:00100000:3.0:1790391204.798699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.798716:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391204.798720:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130755712:0@lo:400: 00000100:00100000:3.0:1790391204.798750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.798785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755840 00000100:00100000:3.0:1790391204.798791:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755840 00000100:00100000:3.0:1790391204.798830:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755456 00000100:00100000:3.0:1790391204.798833:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755456 00000100:00100000:3.0:1790391204.798845:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755712 00000100:00100000:3.0:1790391204.798847:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755712 00000100:00100000:3.0:1790391204.798861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391204.798910:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130755840:12345-0@lo:400: 00000100:00100000:3.0:1790391204.798958:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130755840:12345-0@lo:400: Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.798964:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391204.798978:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391204.798983:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130755456:12345-0@lo:400: 00000100:00100000:3.0:1790391204.799006:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130755456:12345-0@lo:400: Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.799011:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391204.799040:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391204.799046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130755712:12345-0@lo:400: 00000100:00100000:3.0:1790391204.799072:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130755712:12345-0@lo:400: Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.799077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391204.799094:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755584 00000100:00100000:3.0:1790391204.799097:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755584 00000100:00100000:3.0:1790391204.799123:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391204.799128:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130755584:12345-0@lo:400: 00000100:00100000:3.0:1790391204.799155:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130755584:12345-0@lo:400: Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.799161:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790391204.799185:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391204.799189:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391204.799215:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d00f480 x1877361130755712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391204.799228:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130755712:0@lo:400: 00010000:00080000:3.0:1790391204.799239:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d00c700 x1877361130755584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391204.799246:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130755584:0@lo:400: 00010000:00080000:3.0:1790391204.799281:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d00d880 x1877361130755456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391204.799289:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130755456:0@lo:400: 00010000:00080000:3.0:1790391204.799298:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d00d180 x1877361130755840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391204.799305:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130755840:0@lo:400: 00000100:00100000:1.0:1790391204.799735:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130755200:0@lo:8: 00000100:00100000:1.0:1790391204.799781:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.799819:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755328 00000100:00100000:1.0:1790391204.799824:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755328 00000100:00100000:1.0:1790391204.799860:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790391204.799877:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8082:x1877361130755328:12345-0@lo:502: 00000100:00100000:1.0:1790391204.800123:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8082:x1877361130755328:12345-0@lo:502: Request processed in 246us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391204.800131:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790391204.801482:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755200 00000100:00100000:0.0:1790391204.801502:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755200 00000100:00100000:0.0:1790391204.801544:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391204.801550:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1877361130755200:12345-0@lo:8: 00010000:00080000:0.0:1790391204.801579:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1790391204.801609:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449a695 00002000:00100000:0.0:1790391204.801621:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96243fa37800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790391204.801625:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1790391204.801629:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790391204.801748:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790391204.801909:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790391204.801935:0:6697:0:(import.c:65:import_set_state_nolock()) ffff96243fa35000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391204.802011:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1877361130755200:12345-0@lo:8: Request processed in 460us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391204.802049:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391204.802092:0:8082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8082:1877361130755328:0@lo:502: 00000020:01000000:0.0:1790391204.802129:0:8082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391204.802136:0:8082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391204.802138:0:8082:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790391204.802142:0:8082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1790391204.802636:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1790391204.802655:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790391204.802665:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.802676:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391204.802686:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790391204.802688:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962427f099c0 from 1 10000000:01000000:1.0:1790391204.802691:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391204.802722:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.802730:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391204.802739:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391204.802757:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130755968:0@lo:101: 00000100:00100000:1.0:1790391204.802809:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.802848:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a03c0 going to sleep for 11 seconds 00010000:00080000:1.0:1790391204.802889:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa71f80 x1877361130755200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391204.802900:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391204.802907:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790391204.802915:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790391204.802920:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790391204.802923:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962439f99800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790391204.802935:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790391204.802941:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130755200:0@lo:8: 00000004:00080000:0.0:1790391204.806573:0:8083:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790391204.806827:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 240140810581ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790391204.806949:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130755968 00000100:00100000:3.0:1790391204.806960:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130755968 00000100:00100000:3.0:1790391204.807034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790391204.807045:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130755968:12345-0@lo:101: 00010000:00010000:3.0:1790391204.807061:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391204.807078:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a69c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.807106:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a69c expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.807118:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a69c expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.807134:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412d8f000, rc 0) 00000100:00100000:3.0:1790391204.807207:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130755968:12345-0@lo:101: Request processed in 164us (4396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.807225:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790391204.807283:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130755968:0@lo:101: 00010000:00010000:3.0:1790391204.807303:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.807313:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391204.807374:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130756096:0@lo:501: 00000100:00100000:3.0:1790391204.807407:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.807427:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.807441:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756096 00000100:00100000:3.0:1790391204.807444:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756096 00000100:00100000:3.0:1790391204.807465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790391204.807471:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130756096:12345-0@lo:501: 00000100:00100000:3.0:1790391204.807642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130756096:12345-0@lo:501: Request processed in 170us (233us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391204.807648:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790391204.807673:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130756096:0@lo:501: 10000000:01000000:3.0:1790391204.807695:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790391204.807701:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391204.807718:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790391204.857052:0:8084:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790391204.857083:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756352:0@lo:7: 00000100:00100000:1.0:1790391204.857149:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.857199:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391204.857260:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130756224:0@lo:13: 00000100:00100000:0.0:1790391204.857297:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.857380:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756224 00000100:00100000:1.0:1790391204.857388:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756224 00000100:00100000:1.0:1790391204.857450:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391204.857459:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877361130756224:12345-0@lo:13: 00002000:00000024:1.0:1790391204.857499:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790391204.857544:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877361130756224:12345-0@lo:13: Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391204.857551:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790391204.857675:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790391204.857709:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03e680 x1877361130756224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391204.857726:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130756224:0@lo:13: 00000100:00100000:3.0:1790391204.858219:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756352 00000100:00100000:3.0:1790391204.858225:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756352 00000100:00100000:3.0:1790391204.858295:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391204.858304:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8084:x1877361130756352:12345-0@lo:7: 00002000:00080000:3.0:1790391204.865544:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1790391204.865553:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790391204.865645:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8084:x1877361130756352:12345-0@lo:7: Request processed in 7338us (8491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391204.865655:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790391204.865874:0:8084:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03df80 x1877361130756352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391220 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391204.865888:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756352:0@lo:7: 00000004:00080000:1.0:1790391204.865909:0:8084:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790391204.865943:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756480:0@lo:5: 00000100:00100000:1.0:1790391204.865976:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.866011:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.866572:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756480 00000100:00100000:3.0:1790391204.866579:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756480 00000100:00100000:3.0:1790391204.866620:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391204.866629:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8084:x1877361130756480:12345-0@lo:5: 00002000:00080000:3.0:1790391204.866653:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790391204.866657:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790391204.867038:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8084:x1877361130756480:12345-0@lo:5: Request processed in 409us (1059us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790391204.867045:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790391204.867141:0:8084:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03df80 x1877361130756480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391220 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391204.867155:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756480:0@lo:5: 00000004:00080000:1.0:1790391204.867166:0:8084:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790391204.867194:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756608:0@lo:700: 00000100:00100000:1.0:1790391204.867225:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391204.867264:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.867326:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756608 00000100:00100000:3.0:1790391204.867332:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756608 00000100:00100000:3.0:1790391204.867369:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391204.867376:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8084:x1877361130756608:12345-0@lo:700: 00000100:00100000:3.0:1790391204.867403:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1877361130756736:0@lo:700: 00000100:00100000:3.0:1790391204.867428:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391204.867452:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241f1e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391204.867540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756736 00000100:00100000:3.0:1790391204.867544:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756736 00000100:00100000:3.0:1790391204.867579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391204.867585:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1877361130756736:12345-0@lo:700: 00000004:00080000:3.0:1790391204.960683:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1790391205.009767:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1790391205.014384:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1877361130756736:12345-0@lo:700: Request processed in 146789us (146945us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391205.014399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790391205.014633:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f6bb80 x1877361130756736/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790391220 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391205.014649:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1877361130756736:0@lo:700: 40000000:02000000:2.0:1790391205.014677:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1790391205.080759:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1790391205.080786:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1790391205.081088:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8084:x1877361130756608:12345-0@lo:700: Request processed in 213708us (213857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391205.081102:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790391205.082119:0:8084:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03f800 x1877361130756608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790391220 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391205.082133:0:8084:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790391205.082151:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756608:0@lo:700: 00000004:02000040:1.0:1790391205.113595:0:8084:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1790391205.118882:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756864:0@lo:5: 00000100:00100000:2.0:1790391205.118958:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391205.119091:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391205.119686:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756864 00000100:00100000:3.0:1790391205.119697:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756864 00000100:00100000:3.0:1790391205.119880:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790391205.119891:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8084:x1877361130756864:12345-0@lo:5: 00002000:00080000:3.0:1790391205.126701:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790391205.126723:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790391205.131697:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8084:x1877361130756864:12345-0@lo:5: Request processed in 11800us (12730us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790391205.131711:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790391205.131848:0:8084:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d862a00 x1877361130756864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391221 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391205.131875:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8084:1877361130756864:0@lo:5: 00000004:00080000:1.0:1790391205.131894:0:8084:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1790391205.209322:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391206.236081:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391206.810260:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391206.810288:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130756992:0@lo:13: 00000100:00100000:0.0:1790391206.810362:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391206.811150:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130756992 00000100:00100000:1.0:1790391206.811160:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130756992 00000100:00100000:1.0:1790391206.811222:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391206.811246:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130756992:12345-0@lo:13: 00002000:00000024:1.0:1790391206.811283:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391206.811337:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130756992:12345-0@lo:13: Request processed in 93us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391206.811345:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1790391206.811366:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391206.811397:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa73480 x1877361130756992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391206.811418:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130756992:0@lo:13: 00010000:00010000:0.0:1790391207.257712:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391208.282334:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790391208.354197:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1790391208.970677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391208.970714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108713600 00000100:00100000:3.0:1790391208.970722:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108713600 00000100:00100000:3.0:1790391208.970763:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 111 00000100:00100000:3.0:1790391208.970772:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2362:x1877361108713600:12345-192.168.201.8@tcp:250: 00010000:00080000:3.0:1790391208.970813:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 656269f8-80d5-4ea5-97c7-0f2aef046604@192.168.201.8@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1790391208.970840:0:5831:0:(genops.c:1385:class_connect()) connect: client 656269f8-80d5-4ea5-97c7-0f2aef046604, cookie 0x35e94fc15449a6aa 00000100:00080000:3.0:1790391208.970981:0:5831:0:(import.c:65:import_set_state_nolock()) ffff96240e8d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391208.971069:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+5:2362:x1877361108713600:12345-192.168.201.8@tcp:250: Request processed in 296us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391208.971076:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 111 00000100:00100000:3.0:1790391208.983654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391208.983912:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108713728 00000100:00100000:0.0:1790391208.983921:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108713728 00000100:00100000:0.0:1790391208.983976:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00100000:0.0:1790391208.983987:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+5:5591:x1877361108713728:12345-192.168.201.8@tcp:101: 00010000:00010000:0.0:1790391208.984009:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391208.984048:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fb8e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391208.984077:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391208.984087:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391208.984095:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030600, rc 0) 00000100:00100000:0.0:1790391208.984159:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+6:5591:x1877361108713728:12345-192.168.201.8@tcp:101: Request processed in 173us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391208.984165:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00100000:0.0:1790391208.988788:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391208.990101:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108713856 00000100:00100000:3.0:1790391208.990115:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108713856 00000100:00100000:3.0:1790391208.990165:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 113 00000100:00100000:3.0:1790391208.990176:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+6:5591:x1877361108713856:12345-192.168.201.8@tcp:501: 00000100:00100000:3.0:1790391208.990503:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+6:5591:x1877361108713856:12345-192.168.201.8@tcp:501: Request processed in 328us (1723us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391208.990512:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 113 00000100:00100000:2.0:1790391208.992385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391208.992508:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108713984 00000100:00100000:3.0:1790391208.993939:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108713984 00000100:00100000:3.0:1790391208.994009:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 114 00000100:00100000:3.0:1790391208.994037:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+6:5591:x1877361108713984:12345-192.168.201.8@tcp:101: 00010000:00010000:3.0:1790391208.994056:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391208.994074:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fb95 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391208.994102:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391208.994115:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391208.994124:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412d8f200, rc 0) 00000100:00100000:3.0:1790391208.994182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+7:5591:x1877361108713984:12345-192.168.201.8@tcp:101: Request processed in 147us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391208.994190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 114 00000100:00100000:3.0:1790391208.998933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391208.999109:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108714112 00000100:00100000:0.0:1790391208.999119:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108714112 00000100:00100000:0.0:1790391208.999160:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 115 00000100:00100000:0.0:1790391208.999168:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+7:5591:x1877361108714112:12345-192.168.201.8@tcp:501: 00000100:00100000:0.0:1790391208.999391:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5591:x1877361108714112:12345-192.168.201.8@tcp:501: Request processed in 222us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391208.999399:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 115 00000100:00100000:0.0:1790391209.002049:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391209.003269:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108714240 00000100:00100000:2.0:1790391209.003282:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108714240 00000100:00100000:2.0:1790391209.003380:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:2.0:1790391209.003390:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5591:x1877361108714240:12345-192.168.201.8@tcp:503: 00000100:00100000:2.0:1790391209.004003:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5591:x1877361108714240:12345-192.168.201.8@tcp:503: Request processed in 612us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391209.004011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:2.0:1790391209.011090:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391209.011130:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108714368 00000100:00100000:2.0:1790391209.011139:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108714368 00000100:00100000:2.0:1790391209.011188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:2.0:1790391209.011199:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5610:x1877361108714368:12345-192.168.201.8@tcp:502: 00000100:00100000:2.0:1790391209.011558:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5610:x1877361108714368:12345-192.168.201.8@tcp:502: Request processed in 351us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391209.011567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:2.0:1790391209.045960:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391209.046033:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108714496 00000100:00100000:2.0:1790391209.046044:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108714496 00000100:00100000:2.0:1790391209.046093:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:2.0:1790391209.046102:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5610:x1877361108714496:12345-192.168.201.8@tcp:502: 00000100:00100000:2.0:1790391209.046349:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5610:x1877361108714496:12345-192.168.201.8@tcp:502: Request processed in 247us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391209.046358:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:3.0:1790391209.049861:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391209.049908:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108714624 00000100:00100000:3.0:1790391209.049917:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108714624 00000100:00100000:3.0:1790391209.049963:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:3.0:1790391209.049972:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5591:x1877361108714624:12345-192.168.201.8@tcp:101: 00010000:00010000:3.0:1790391209.049988:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391209.050005:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412d8fa00/0x35e94fc15449a6bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fbbf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391209.050051:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8fa00/0x35e94fc15449a6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbbf expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391209.050063:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412d8fa00/0x35e94fc15449a6bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbbf expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391209.050072:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412d8fa00, rc 0) 00000100:00100000:3.0:1790391209.050139:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5591:x1877361108714624:12345-192.168.201.8@tcp:101: Request processed in 155us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391209.050145:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:2.0:1790391209.068701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391209.072917:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108714752 00000100:00100000:0.0:1790391209.072948:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108714752 00000100:00100000:1.0:1790391209.073084:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:1.0:1790391209.073095:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5591:x1877361108714752:12345-192.168.201.8@tcp:256: 20000000:01000000:1.0:1790391209.073121:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790391209.073291:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790391209.073296:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790391209.073299:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790391209.073302:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1790391209.079068:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5591:x1877361108714752:12345-192.168.201.8@tcp:256: Request processed in 5964us (10365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391209.079082:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:0.0:1790391209.084201:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391209.084464:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108714880 00000100:00100000:3.0:1790391209.084474:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108714880 00000100:00100000:3.0:1790391209.084701:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:3.0:1790391209.084712:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5591:x1877361108714880:12345-192.168.201.8@tcp:101: 00010000:00010000:3.0:1790391209.084730:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391209.084749:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fbc6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391209.084777:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391209.084816:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391209.084824:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412d8e200, rc 0) 00000100:00100000:3.0:1790391209.084886:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5591:x1877361108714880:12345-192.168.201.8@tcp:101: Request processed in 175us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391209.084894:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:2.0:1790391209.088477:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391209.088633:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715008 00000100:00100000:1.0:1790391209.088646:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715008 00000100:00100000:1.0:1790391209.088736:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:1.0:1790391209.088747:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5591:x1877361108715008:12345-192.168.201.8@tcp:501: 00000100:00100000:1.0:1790391209.089254:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5591:x1877361108715008:12345-192.168.201.8@tcp:501: Request processed in 507us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391209.089274:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:0.0:1790391209.090884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391209.091461:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715136 00000100:00100000:3.0:1790391209.091471:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715136 00000100:00100000:3.0:1790391209.091524:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:3.0:1790391209.091534:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5591:x1877361108715136:12345-192.168.201.8@tcp:503: 00000100:00100000:3.0:1790391209.092005:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5591:x1877361108715136:12345-192.168.201.8@tcp:503: Request processed in 471us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391209.092034:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:3.0:1790391209.097950:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391209.098387:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715264 00000100:00100000:1.0:1790391209.098399:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715264 00000100:00100000:1.0:1790391209.098466:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:1.0:1790391209.098477:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5612:x1877361108715264:12345-192.168.201.8@tcp:502: 00000100:00100000:1.0:1790391209.098767:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5612:x1877361108715264:12345-192.168.201.8@tcp:502: Request processed in 291us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391209.098776:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:2.0:1790391209.101780:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391209.101871:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715392 00000100:00100000:1.0:1790391209.101882:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715392 00000100:00100000:1.0:1790391209.101937:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 125 00000100:00100000:1.0:1790391209.101946:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5612:x1877361108715392:12345-192.168.201.8@tcp:502: 00000100:00100000:1.0:1790391209.102494:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5612:x1877361108715392:12345-192.168.201.8@tcp:502: Request processed in 547us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391209.102505:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 125 00000100:00100000:2.0:1790391209.114599:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391209.114735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715520 00000100:00100000:3.0:1790391209.114745:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715520 00000100:00100000:3.0:1790391209.114805:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:3.0:1790391209.114814:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2362:x1877361108715520:12345-192.168.201.8@tcp:38: 00010000:00080000:3.0:1790391209.114845:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1790391209.114895:0:5837:0:(genops.c:1385:class_connect()) connect: client df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f, cookie 0x35e94fc15449a6cd 00000004:00100000:3.0:1790391209.114926:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1790391209.114932:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1790391209.201722:0:5837:0:(import.c:65:import_set_state_nolock()) ffff96240e8da000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391209.201817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2362:x1877361108715520:12345-192.168.201.8@tcp:38: Request processed in 87002us (87227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391209.201839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00010000:00010000:0.0:1790391209.305389:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391209.881613:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130757120:0@lo:13: 00000100:00100000:2.0:1790391209.881679:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391209.881855:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130757120 00000100:00100000:1.0:1790391209.881864:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130757120 00000100:00100000:1.0:1790391209.881934:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391209.881944:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130757120:12345-0@lo:13: 00002000:00000024:1.0:1790391209.881979:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391209.882050:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130757120:12345-0@lo:13: Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391209.882057:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790391209.882101:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03f800 x1877361130757120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790391209.882196:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391209.882364:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790391209.882526:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130757120:0@lo:13: 00000100:00100000:3.0:1790391209.884552:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130757248:0@lo:400: 00000100:00100000:3.0:1790391209.884697:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391209.884749:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130757760:0@lo:400: 00000100:00100000:3.0:1790391209.884775:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391209.884868:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391209.884875:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130757376:0@lo:400: 00000100:00100000:3.0:1790391209.884896:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391209.884926:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130757760 00000100:00100000:3.0:1790391209.884932:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130757760 00000100:00100000:3.0:1790391209.884982:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130757376 00000100:00100000:3.0:1790391209.884986:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130757376 00000100:00100000:3.0:1790391209.885002:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391209.885010:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130757760:12345-0@lo:400: 00000100:00100000:3.0:1790391209.885093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130757760:12345-0@lo:400: Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391209.885100:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391209.885227:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391209.885237:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130757376:12345-0@lo:400: 00000100:00100000:0.0:1790391209.885348:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130757376:12345-0@lo:400: Request processed in 113us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391209.885355:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790391209.885378:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790391209.885490:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d860700 x1877361130757376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391209.885505:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130757376:0@lo:400: 00010000:00080000:0.0:1790391209.885516:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d863800 x1877361130757760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391209.885523:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130757760:0@lo:400: 00000100:00100000:1.0:1790391209.885611:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130757504:0@lo:400: 00000100:00100000:1.0:1790391209.885644:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391209.885676:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391209.885682:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130757632:0@lo:400: 00000100:00100000:1.0:1790391209.885708:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391209.885910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130757248 00000100:00100000:2.0:1790391209.885915:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130757248 00000100:00100000:2.0:1790391209.885954:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790391209.885962:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130757248:12345-0@lo:400: 00000100:00100000:2.0:1790391209.886011:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130757248:12345-0@lo:400: Request processed in 50us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391209.886038:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790391209.886203:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130757504 00000100:00100000:0.0:1790391209.886208:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130757504 00000100:00100000:1.0:1790391209.886493:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130757632 00000100:00100000:1.0:1790391209.886498:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130757632 00000100:00100000:0.0:1790391209.887182:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391209.887190:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130757504:12345-0@lo:400: 00000100:00100000:0.0:1790391209.887246:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130757504:12345-0@lo:400: Request processed in 57us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391209.887263:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391209.887299:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130757248:0@lo:400: 00010000:00080000:0.0:1790391209.887331:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d862d80 x1877361130757504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391209.887356:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130757504:0@lo:400: 00000100:00080000:2.0:1790391209.890699:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391209.890712:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391209.890893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790391209.890905:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130757632:12345-0@lo:400: 00000100:00100000:1.0:1790391209.891041:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130757632:12345-0@lo:400: Request processed in 130us (5323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391209.891048:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790391209.892176:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d863b80 x1877361130757632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391209.892192:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130757632:0@lo:400: 00000100:00100000:3.0:1790391210.210008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391210.210083:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391210.210364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715776 00000100:00100000:1.0:1790391210.210373:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715776 00000100:00100000:1.0:1790391210.210441:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715648 00000100:00100000:1.0:1790391210.210444:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715648 00000100:00100000:1.0:1790391210.210458:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:1.0:1790391210.210467:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:5591:x1877361108715776:12345-192.168.201.8@tcp:41: 00000004:00000024:1.0:1790391210.210506:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790391210.210563:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:5591:x1877361108715776:12345-192.168.201.8@tcp:41: Request processed in 96us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391210.210570:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:1.0:1790391210.210598:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:1.0:1790391210.210604:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:0:x1877361108715648:12345-192.168.201.8@tcp:41: 00000004:00000024:1.0:1790391210.210627:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790391210.210645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:0:x1877361108715648:12345-192.168.201.8@tcp:41: Request processed in 42us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391210.210651:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00080000:2.0:1790391210.210931:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391210.216007:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391210.216239:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108715904 00000100:00100000:1.0:1790391210.216259:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108715904 00000100:00100000:1.0:1790391210.216311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:1.0:1790391210.216319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5591:x1877361108715904:12345-192.168.201.8@tcp:40: 00000100:00100000:1.0:1790391210.216392:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5591:x1877361108715904:12345-192.168.201.8@tcp:40: Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391210.216399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:1.0:1790391210.223915:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391210.223963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391210.223998:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391210.224060:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391210.224206:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716032 00000100:00100000:0.0:1790391210.224217:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716032 00000100:00100000:0.0:1790391210.224264:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716160 00000100:00100000:0.0:1790391210.224267:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716160 00000100:00100000:2.0:1790391210.224271:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716288 00000100:00100000:2.0:1790391210.224274:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716288 00000100:00100000:0.0:1790391210.224281:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:0.0:1790391210.224289:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1877361108716032:12345-192.168.201.8@tcp:8: 00000100:00100000:2.0:1790391210.224302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391210.224308:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5591:x1877361108716288:12345-192.168.201.8@tcp:33: 00010000:00080000:0.0:1790391210.224318:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1790391210.224345:0:6695:0:(genops.c:1385:class_connect()) connect: client df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f, cookie 0x35e94fc15449a6d4 00002000:00100000:0.0:1790391210.224356:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f/ffff96243fa34000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391210.224389:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391210.224733:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391210.224760:0:6695:0:(import.c:65:import_set_state_nolock()) ffff96243fa30000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391210.225694:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716416 00000100:00100000:3.0:1790391210.225704:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716416 00000100:00100000:3.0:1790391210.225749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:3.0:1790391210.225757:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2365:x1877361108716416:12345-192.168.201.8@tcp:400: 00000100:00100000:0.0:1790391210.230684:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2362:x1877361108716032:12345-192.168.201.8@tcp:8: Request processed in 6382us (6672us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391210.230698:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:0.0:1790391210.230738:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1790391210.230745:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1877361108716160:12345-192.168.201.8@tcp:8: 00010000:00080000:0.0:1790391210.230792:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1790391210.230832:0:6695:0:(genops.c:1385:class_connect()) connect: client df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f, cookie 0x35e94fc15449a6db 00002000:00100000:0.0:1790391210.231099:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f/ffff96243fa36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391210.231111:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1790391210.231490:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2365:x1877361108716416:12345-192.168.201.8@tcp:400: Request processed in 5730us (7523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391210.231501:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 127 00002000:00080000:0.0:1790391210.231750:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790391210.231806:0:6695:0:(import.c:65:import_set_state_nolock()) ffff96243fa35800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391210.231941:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2362:x1877361108716160:12345-192.168.201.8@tcp:8: Request processed in 1194us (7879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391210.231949:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000004:00080000:1.0:1790391210.251678:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27297us 00000004:00200000:1.0:1790391210.272764:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790391210.272903:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5591:x1877361108716288:12345-192.168.201.8@tcp:33: Request processed in 48589us (49004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391210.272929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00010000:00010000:0.0:1790391210.332766:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391210.483127:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391210.483222:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716544 00000100:00100000:0.0:1790391210.483230:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716544 00000100:00100000:0.0:1790391210.483284:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:0.0:1790391210.483296:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5629:x1877361108716544:12345-192.168.201.8@tcp:101: 00010000:00010000:0.0:1790391210.483316:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391210.483392:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449a6e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fbf0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391210.483468:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a6e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391210.483481:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391210.483505:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391210.483538:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790391210.483541:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391210.483554:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391210.483575:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449a6e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbf0 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391210.483606:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbf0 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391210.483612:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751e00) 00010000:00010000:0.0:1790391210.483614:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391210.483618:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031800, rc 0) 00000100:00100000:0.0:1790391210.483679:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:5629:x1877361108716544:12345-192.168.201.8@tcp:101: Request processed in 385us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391210.483685:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00010000:00010000:0.0:1790391211.354654:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391211.929238:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130757888:0@lo:13: 00000100:00100000:2.0:1790391211.929315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391211.932474:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130757888 00000100:00100000:1.0:1790391211.932490:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130757888 00000100:00100000:1.0:1790391211.933515:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391211.933529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130757888:12345-0@lo:13: 00002000:00000024:1.0:1790391211.933567:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391211.933670:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130757888:12345-0@lo:13: Request processed in 145us (4355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391211.933676:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790391211.935911:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa72300 x1877361130757888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391211.935944:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130757888:0@lo:13: 00000100:00080000:2.0:1790391211.941984:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391212.377299:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391212.756966:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391212.757054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716672 00000100:00100000:3.0:1790391212.757063:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716672 00000100:00100000:3.0:1790391212.757135:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1790391212.757146:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:5681:x1877361108716672:12345-192.168.201.8@tcp:41: 00000004:00000024:3.0:1790391212.757185:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790391212.757258:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:5681:x1877361108716672:12345-192.168.201.8@tcp:41: Request processed in 114us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391212.757265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00080000:2.0:1790391212.757331:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391212.762376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391212.762844:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716800 00000100:00100000:1.0:1790391212.762862:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716800 00000100:00100000:1.0:1790391212.762925:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:1.0:1790391212.762934:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5681:x1877361108716800:12345-192.168.201.8@tcp:13: 00002000:00000024:1.0:1790391212.762958:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391212.763045:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5681:x1877361108716800:12345-192.168.201.8@tcp:13: Request processed in 83us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391212.763052:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00080000:2.0:1790391212.763215:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391212.766721:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391212.767750:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108716928 00000100:00100000:1.0:1790391212.767762:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108716928 00000100:00100000:1.0:1790391212.767882:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391212.767893:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5681:x1877361108716928:12345-192.168.201.8@tcp:13: 00002000:00000024:1.0:1790391212.767927:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391212.767982:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:5681:x1877361108716928:12345-192.168.201.8@tcp:13: Request processed in 93us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391212.767987:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00080000:2.0:1790391212.768040:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790391213.405802:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391214.426466:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790391214.555495:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000001:00100000:1.0:1790391214.569122:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000001:00100000:0.0:1790391214.576127:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000100:00100000:3.0:1790391215.001312:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130758016:0@lo:13: 00000100:00100000:3.0:1790391215.001385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391215.001588:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130758016 00000100:00100000:1.0:1790391215.001596:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130758016 00000100:00100000:1.0:1790391215.001657:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391215.001666:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130758016:12345-0@lo:13: 00002000:00000024:1.0:1790391215.001731:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790391215.001751:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391215.001780:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130758016:12345-0@lo:13: Request processed in 115us (395us total) trans 0 rc 0/0 00010000:00080000:3.0:1790391215.001799:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03e300 x1877361130758016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391215.001810:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391215.001817:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130758016:0@lo:13: 00000100:00100000:0.0:1790391215.004109:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130758400:0@lo:400: 00000100:00100000:0.0:1790391215.004165:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391215.004197:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391215.004203:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130758272:0@lo:400: 00000100:00100000:0.0:1790391215.004239:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391215.004269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130758272 00000100:00100000:0.0:1790391215.004285:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130758272 00000100:00100000:0.0:1790391215.004333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391215.004340:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130758272:12345-0@lo:400: 00000100:00100000:0.0:1790391215.004383:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130758272:12345-0@lo:400: Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391215.004389:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391215.004424:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130758272:0@lo:400: 00000100:00100000:1.0:1790391215.004657:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130758400 00000100:00100000:1.0:1790391215.004661:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130758400 00000100:00100000:2.0:1790391215.004665:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130758144:0@lo:400: 00000100:00100000:2.0:1790391215.004709:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391215.004718:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391215.004725:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130758400:12345-0@lo:400: 00000100:00100000:2.0:1790391215.004735:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130758656:0@lo:400: 00000100:00100000:2.0:1790391215.004755:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391215.004764:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130758400:12345-0@lo:400: Request processed in 39us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391215.004770:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391215.004771:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391215.004776:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130758528:0@lo:400: 00010000:00080000:1.0:1790391215.004794:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa71880 x1877361130758400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391215.004797:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391215.004806:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130758400:0@lo:400: 00000100:00100000:2.0:1790391215.004818:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130758144 00000100:00100000:2.0:1790391215.004821:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130758144 00000100:00100000:2.0:1790391215.004853:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1790391215.004856:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391215.004860:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130758144:12345-0@lo:400: 00000100:00100000:2.0:1790391215.004899:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130758144:12345-0@lo:400: Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391215.004906:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790391215.004932:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130758656 00000100:00100000:3.0:1790391215.004935:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130758144:0@lo:400: 00000100:00100000:2.0:1790391215.004935:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130758656 00000100:00100000:2.0:1790391215.004972:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130758528 00000100:00100000:2.0:1790391215.004975:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130758528 00000100:00080000:1.0:1790391215.004976:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391215.004983:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391215.004991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391215.005005:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130758656:12345-0@lo:400: 00000100:00100000:3.0:1790391215.005037:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790391215.005045:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790391215.005061:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130758656:12345-0@lo:400: Request processed in 57us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391215.005067:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391215.005078:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391215.005085:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130758528:12345-0@lo:400: 00000100:00100000:2.0:1790391215.005111:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130758528:12345-0@lo:400: Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391215.005116:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391215.005191:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130758528:0@lo:400: 00000100:00100000:1.0:1790391215.005207:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130758656:0@lo:400: 00000001:02000400:2.0:1790391215.174311:0:8311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790391215.383736:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391215.383795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391215.383901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391215.383993:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391215.384047:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717184 00000100:00100000:2.0:1790391215.384056:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717184 00000100:00100000:2.0:1790391215.384119:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:2.0:1790391215.384129:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108717184:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1790391215.384200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108717184:12345-192.168.201.8@tcp:400: Request processed in 72us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391215.384208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:3.0:1790391215.384287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717056 00000100:00100000:3.0:1790391215.384292:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717056 00000100:00100000:3.0:1790391215.384327:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 129 00000100:00100000:3.0:1790391215.384334:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108717056:12345-192.168.201.8@tcp:400: 00000100:00100000:3.0:1790391215.384377:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108717056:12345-192.168.201.8@tcp:400: Request processed in 43us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391215.384384:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 129 00000100:00100000:1.0:1790391215.385659:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717440 00000100:00100000:1.0:1790391215.385668:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717440 00000100:00100000:1.0:1790391215.385767:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717312 00000100:00100000:1.0:1790391215.385771:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717312 00000100:00100000:2.0:1790391215.385974:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:2.0:1790391215.385984:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108717440:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1790391215.386065:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108717440:12345-192.168.201.8@tcp:400: Request processed in 82us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391215.386072:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:2.0:1790391215.386088:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:2.0:1790391215.386095:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108717312:12345-192.168.201.8@tcp:400: 00000100:00100000:2.0:1790391215.386119:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108717312:12345-192.168.201.8@tcp:400: Request processed in 24us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391215.386137:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00080000:1.0:1790391215.387079:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391215.387087:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391215.387090:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391215.452566:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391216.476759:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391217.055669:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130758784:0@lo:13: 00000100:00100000:3.0:1790391217.056474:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391217.056807:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130758784 00000100:00100000:1.0:1790391217.056816:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130758784 00000100:00100000:1.0:1790391217.056882:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391217.056892:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130758784:12345-0@lo:13: 00002000:00000024:1.0:1790391217.056943:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391217.056995:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130758784:12345-0@lo:13: Request processed in 105us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391217.057002:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1790391217.057010:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03c000 x1877361130758784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391217.057047:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130758784:0@lo:13: 00000100:00080000:2.0:1790391217.057073:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391217.499192:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391218.523313:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790391218.632308:0:8459:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff76c6de10 20000000:00000080:2.0:1790391218.632324:0:8459:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962439eacc00 uarg=0000000000000000 20000000:01000000:2.0:1790391218.632359:0:8459:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1790391218.632361:0:8459:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1790391218.632364:0:8459:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790391218.632368:0:8459:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1790391218.632373:0:8459:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1790391218.632387:0:8459:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790391218.632389:0:8459:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790391218.632631:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790391218.632634:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790391218.633474:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1790391218.633895:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1790391218.633957:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1790391218.633995:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1790391218.634007:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790391218.634010:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790391218.635343:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1790391218.635723:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1790391218.635771:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1790391218.635808:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1790391218.635821:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1790391218.635823:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790391218.636739:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1790391218.637262:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1790391218.637324:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1790391218.637362:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1790391218.637375:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790391218.637378:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790391218.637992:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1790391218.638721:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1790391218.638768:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1790391218.638827:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1790391218.638844:0:8459:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790391218.638865:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638884:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638892:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a610 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638900:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a63a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638905:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a648 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638911:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a656 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638916:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a672 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638922:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a69c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638931:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638937:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638956:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.638993:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639006:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 9 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639254:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130758912:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391218.639405:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639414:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 9 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639423:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759040:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391218.639455:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a69c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639464:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a69c expref: 18 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639473:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b49f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759168:0@lo:104: 00000100:00100000:2.0:1790391218.639510:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391218.639553:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a672 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639571:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a672 expref: 18 pid: 5831 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639580:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759296:0@lo:104: 00000100:00100000:2.0:1790391218.639608:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391218.639649:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a656 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639656:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a656 expref: 18 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639665:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b48000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759424:0@lo:104: 00010000:00010000:2.0:1790391218.639690:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a648 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639697:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a648 expref: 18 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639705:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759552:0@lo:104: 00010000:00010000:2.0:1790391218.639727:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a63a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639734:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a63a expref: 18 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639742:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759680:0@lo:104: 00010000:00010000:2.0:1790391218.639764:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a610 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639783:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a610 expref: 18 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639791:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759808:0@lo:104: 00010000:00010000:2.0:1790391218.639816:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.639823:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 18 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.639829:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759936:0@lo:104: 00000100:00100000:2.0:1790391218.639844:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391218.639910:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790391218.639929:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.639940:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.639948:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.639954:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.639961:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.639968:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130759168 00000100:00100000:1.0:1790391218.639973:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130759168 00000100:00100000:1.0:1790391218.640007:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130759296 00000100:00100000:1.0:1790391218.640009:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130759296 00000100:00100000:1.0:1790391218.640055:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130759424 00000100:00100000:1.0:1790391218.640058:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130759424 00000100:00100000:1.0:1790391218.640068:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130759552 00000100:00100000:1.0:1790391218.640070:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130759552 00000100:00100000:1.0:1790391218.640078:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130759680 00000100:00100000:1.0:1790391218.640080:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130759680 00000100:00100000:1.0:1790391218.640088:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130759808 00000100:00100000:1.0:1790391218.640090:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130759808 00000100:00100000:1.0:1790391218.640097:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130759936 00000100:00100000:1.0:1790391218.640099:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130759936 00000100:00100000:1.0:1790391218.640110:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391218.640119:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+9:8459:x1877361130759168:12345-0@lo:104: 00010000:00010000:1.0:1790391218.640132:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640292:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391218.640298:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+9:8459:x1877361130759168:12345-0@lo:104: Request processed in 181us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.640312:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391218.640327:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391218.640332:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f900050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+8:8459:x1877361130759296:12345-0@lo:104: 00010000:00010000:1.0:1790391218.640339:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640368:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790391218.640372:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f900050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+8:8459:x1877361130759296:12345-0@lo:104: Request processed in 41us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.640378:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391218.640407:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391218.640412:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+7:8459:x1877361130759424:12345-0@lo:104: 00010000:00010000:1.0:1790391218.640420:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640445:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790391218.640449:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+7:8459:x1877361130759424:12345-0@lo:104: Request processed in 38us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.640455:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391218.640466:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391218.640472:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+6:8459:x1877361130759552:12345-0@lo:104: 00010000:00010000:1.0:1790391218.640478:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640502:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790391218.640506:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+6:8459:x1877361130759552:12345-0@lo:104: Request processed in 35us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.640518:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391218.640530:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391218.640535:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+5:8459:x1877361130759680:12345-0@lo:104: 00010000:00010000:1.0:1790391218.640543:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640567:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790391218.640571:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+5:8459:x1877361130759680:12345-0@lo:104: Request processed in 37us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.640576:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391218.640588:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391218.640592:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+4:8459:x1877361130759808:12345-0@lo:104: 00010000:00010000:1.0:1790391218.640598:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640617:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1790391218.640621:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+4:8459:x1877361130759808:12345-0@lo:104: Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.640625:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391218.640633:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391218.640649:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+3:8459:x1877361130759936:12345-0@lo:104: 00010000:00010000:1.0:1790391218.640655:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640680:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1790391218.640684:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c86877e-0672-4feb-acd6-39a38006ba27+3:8459:x1877361130759936:12345-0@lo:104: Request processed in 37us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.640695:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790391218.640713:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1790391218.640719:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640726:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31200 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391218.640730:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640739:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391218.640746:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391218.640752:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391218.640780:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640786:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391218.640802:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640808:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a6a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640825:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1790391218.640828:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640843:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391218.640846:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640853:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391218.640859:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391218.640864:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391218.640877:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640883:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391218.640896:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640903:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a679 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640914:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790391218.640916:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640922:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30200 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391218.640924:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640941:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391218.640947:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391218.640952:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391218.640964:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640970:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391218.640976:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640982:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e30200/0x35e94fc15449a656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a65d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640990:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790391218.640993:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.640999:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8e400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391218.641002:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641008:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.641131:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391218.641145:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130760064:0@lo:103: 00000100:00100000:3.0:1790391218.641190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391218.641226:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760064 00000100:00100000:3.0:1790391218.641231:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760064 00010000:00010000:3.0:1790391218.641252:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a69c expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.641275:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391218.641281:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130760064:12345-0@lo:103: 00010000:00010000:3.0:1790391218.641291:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391218.641295:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a69c expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.641305:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a69c expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.641321:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391218.641346:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130760064:12345-0@lo:103: Request processed in 66us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391218.641358:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391218.641394:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130760064:0@lo:103: 10000000:00010000:1.0:1790391218.641517:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391218.641529:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391218.641545:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641551:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391218.641558:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641564:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8e400/0x35e94fc15449a648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a64f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641573:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790391218.641576:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641582:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391218.641585:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641592:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391218.641597:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391218.641603:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391218.641614:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641619:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391218.641628:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641644:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a63a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a641 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641653:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391218.641657:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641663:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8f600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391218.641666:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641673:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391218.641679:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391218.641684:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391218.641705:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641710:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391218.641714:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641720:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8f600/0x35e94fc15449a610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a617 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641728:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391218.641735:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641740:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8f400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391218.641743:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641750:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391218.641756:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391218.641761:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391218.641770:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641775:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391218.641779:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641785:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8f400/0x35e94fc15449a5e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a5ed expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.641796:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391218.641797:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391218.641799:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391218.641815:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130760576:0@lo:103: 00000100:00100000:1.0:1790391218.641838:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.641856:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391218.641860:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130760448:0@lo:103: 00000100:00100000:1.0:1790391218.641881:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.641898:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760192:0@lo:103: 00000100:00100000:1.0:1790391218.641913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.641923:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760704:0@lo:103: 00000100:00100000:1.0:1790391218.641936:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.641944:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391218.641948:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760320:0@lo:103: 00000100:00100000:1.0:1790391218.641961:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.641968:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760832:0@lo:103: 00000100:00100000:1.0:1790391218.641984:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391218.642002:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760576 00000100:00100000:1.0:1790391218.642005:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760576 00010000:00010000:2.0:1790391218.642141:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8f000/0x35e94fc15449a6a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a69c expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391218.642153:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b49f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759168:0@lo:104: 00000100:00100000:2.0:1790391218.642162:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759296:0@lo:104: 00000100:00100000:2.0:1790391218.642169:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b48000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759424:0@lo:104: 00000100:00100000:2.0:1790391218.642187:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759552:0@lo:104: 00000100:00100000:2.0:1790391218.642194:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759680:0@lo:104: 00000100:00100000:2.0:1790391218.642201:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759808:0@lo:104: 00000100:00100000:2.0:1790391218.642208:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759936:0@lo:104: 00000100:00100000:3.0:1790391218.642321:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760448 00000100:00100000:3.0:1790391218.642326:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760448 00010000:00010000:3.0:1790391218.642343:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a648 expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.642358:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760192 00000100:00100000:3.0:1790391218.642360:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760192 00010000:00010000:3.0:1790391218.642367:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a672 expref: 20 pid: 5831 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.642376:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760704 00000100:00100000:3.0:1790391218.642378:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760704 00010000:00010000:3.0:1790391218.642388:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a610 expref: 21 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.642397:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760320 00000100:00100000:3.0:1790391218.642399:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760320 00010000:00010000:3.0:1790391218.642408:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a656 expref: 22 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.642416:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760832 00000100:00100000:3.0:1790391218.642418:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760832 00010000:00010000:3.0:1790391218.642427:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 23 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.642439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391218.642446:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+23:3310:x1877361130760448:12345-0@lo:103: 00010000:00010000:3.0:1790391218.642455:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391218.642466:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a648 expref: 23 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642475:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a648 expref: 23 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642487:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8fc00/0x35e94fc15449a64f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a648 expref: 23 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642496:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391218.642530:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+22:3310:x1877361130760448:12345-0@lo:103: Request processed in 84us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391218.642536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391218.642550:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391218.642556:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+21:3307:x1877361130760192:12345-0@lo:103: 00010000:00010000:3.0:1790391218.642563:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391218.642567:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a672 expref: 21 pid: 5831 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642575:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a672 expref: 21 pid: 5831 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642584:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8e600/0x35e94fc15449a679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a672 expref: 21 pid: 5831 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642592:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391218.642613:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+20:3307:x1877361130760192:12345-0@lo:103: Request processed in 58us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391218.642619:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391218.642628:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391218.642649:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130760704:12345-0@lo:103: 00010000:00010000:3.0:1790391218.642657:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391218.642661:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a610 expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642669:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a610 expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642678:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a0200/0x35e94fc15449a617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a610 expref: 19 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642687:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391218.642704:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+18:3307:x1877361130760704:12345-0@lo:103: Request processed in 67us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391218.642709:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391218.642719:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391218.642724:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+17:3307:x1877361130760320:12345-0@lo:103: 00010000:00010000:3.0:1790391218.642730:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391218.642733:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a656 expref: 17 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642741:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a656 expref: 17 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642750:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030800/0x35e94fc15449a65d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a656 expref: 17 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642757:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391218.642772:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3307:x1877361130760320:12345-0@lo:103: Request processed in 49us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391218.642784:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391218.642793:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391218.642798:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962408360050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+15:3307:x1877361130760832:12345-0@lo:103: 00010000:00010000:3.0:1790391218.642804:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391218.642808:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 15 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642816:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 15 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642824:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400031a00/0x35e94fc15449a5ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a5e6 expref: 15 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391218.642831:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391218.642846:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962408360050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+14:3307:x1877361130760832:12345-0@lo:103: Request processed in 49us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391218.642851:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391218.642874:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130760448:0@lo:103: 00000100:00100000:3.0:1790391218.642893:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760320:0@lo:103: 00000100:00100000:3.0:1790391218.642900:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760832:0@lo:103: 00000100:00100000:3.0:1790391218.642905:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760192:0@lo:103: 00000100:00100000:3.0:1790391218.642911:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130760704:0@lo:103: 00010000:00010000:1.0:1790391218.643298:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a63a expref: 13 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391218.643324:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391218.643332:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+13:3310:x1877361130760576:12345-0@lo:103: 00010000:00010000:1.0:1790391218.643339:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391218.643343:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a63a expref: 13 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.643350:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a63a expref: 13 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.643361:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030400/0x35e94fc15449a641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a63a expref: 13 pid: 5830 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391218.643369:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391218.643448:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+12:3310:x1877361130760576:12345-0@lo:103: Request processed in 118us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391218.643455:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1790391218.643736:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391218.643957:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130760576:0@lo:103: 00000100:00100000:2.0:1790391218.647792:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130759040:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391218.648709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391218.648786:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717568 00000100:00100000:0.0:1790391218.648793:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717568 00010000:00010000:0.0:1790391218.648831:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 10 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391218.648869:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:0.0:1790391218.648879:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2364:x1877361108717568:12345-192.168.201.8@tcp:103: 00010000:00010000:0.0:1790391218.648893:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391218.648899:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 10 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.648923:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 10 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.648939:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030600/0x35e94fc15449a6b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb8e expref: 10 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.648955:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391218.649053:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:2364:x1877361108717568:12345-192.168.201.8@tcp:103: Request processed in 174us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391218.649059:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:2.0:1790391218.652000:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1877361130758912:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391218.652116:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391218.661719:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391218.661914:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717696 00000100:00100000:0.0:1790391218.661924:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717696 00010000:00010000:0.0:1790391218.661964:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 9 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391218.666268:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:0.0:1790391218.666313:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:656269f8-80d5-4ea5-97c7-0f2aef046604+9:2363:x1877361108717696:12345-192.168.201.8@tcp:103: 00010000:00010000:0.0:1790391218.666335:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391218.666346:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 9 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666469:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 9 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666488:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8f200/0x35e94fc15449a6b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fb95 expref: 9 pid: 5831 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666505:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666526:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666542:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666549:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666555:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666561:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666568:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391218.666572:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666580:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666599:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391218.666610:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391218.666680:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:656269f8-80d5-4ea5-97c7-0f2aef046604+8:2363:x1877361108717696:12345-192.168.201.8@tcp:103: Request processed in 389us (4969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391218.666687:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00010000:00010000:2.0:1790391218.666781:0:8459:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.666790:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391218.666797:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391219.545252:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391220.121300:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130760960:0@lo:400: 00000100:00100000:0.0:1790391220.121386:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.121550:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130760960 00000100:00100000:2.0:1790391220.121568:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130760960 00000100:00100000:2.0:1790391220.121645:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790391220.121655:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:3309:x1877361130760960:12345-0@lo:400: 00000100:00100000:0.0:1790391220.121800:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130761472:0@lo:400: 00000100:00100000:0.0:1790391220.121826:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.128539:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130761088:0@lo:13: 00000100:00100000:1.0:1790391220.128625:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.128694:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130761344:0@lo:400: 00000100:00100000:1.0:1790391220.128722:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.128740:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391220.128747:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130761216:0@lo:400: 00000100:00100000:1.0:1790391220.128772:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.128804:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761088 00000100:00100000:1.0:1790391220.128811:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761088 00000100:00100000:1.0:1790391220.128865:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391220.128874:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130761088:12345-0@lo:13: 00002000:00000024:1.0:1790391220.128909:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391220.128950:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130761088:12345-0@lo:13: Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.128957:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391220.128977:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761344 00000100:00100000:1.0:1790391220.128980:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761344 00000100:00100000:1.0:1790391220.129003:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391220.129009:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130761344:12345-0@lo:400: 00000100:00100000:1.0:1790391220.129053:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130761344:12345-0@lo:400: Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.129059:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790391220.129104:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f6aa00 x1877361130761344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391220.129131:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130761344:0@lo:400: 00010000:00080000:1.0:1790391220.129156:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439940380 x1877361130761088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391220.129169:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130761088:0@lo:13: 00000100:00080000:1.0:1790391220.129206:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391220.129210:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391220.129218:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761472 00000100:00100000:1.0:1790391220.129221:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761472 00000100:00100000:1.0:1790391220.129245:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761216 00000100:00100000:1.0:1790391220.129248:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761216 00000100:00100000:1.0:1790391220.129262:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391220.129268:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130761472:12345-0@lo:400: 00000100:00100000:1.0:1790391220.129297:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130761472:12345-0@lo:400: Request processed in 29us (7470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.129303:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391220.129314:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391220.129319:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130761216:12345-0@lo:400: 00000100:00100000:1.0:1790391220.129345:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130761216:12345-0@lo:400: Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.129351:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790391220.129366:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391220.129382:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130761216:0@lo:400: 00000100:00100000:1.0:1790391220.131778:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130761600:0@lo:400: 00000100:00100000:1.0:1790391220.131837:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.132457:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761600 00000100:00100000:3.0:1790391220.132476:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761600 00000100:00100000:3.0:1790391220.132537:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790391220.132546:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130761600:12345-0@lo:400: 00000100:00100000:3.0:1790391220.132599:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130761600:12345-0@lo:400: Request processed in 55us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.132606:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790391220.132661:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130761600:0@lo:400: 00000100:00080000:1.0:1790391220.132730:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391220.136190:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+12:3309:x1877361130760960:12345-0@lo:400: Request processed in 14526us (14793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391220.136205:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790391220.139726:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130760960:0@lo:400: 00000100:00100000:0.0:1790391220.139770:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130761472:0@lo:400: 10000000:01000000:1.0:1790391220.249274:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391220.249283:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96243f8f8000 from 39 10000000:01000000:1.0:1790391220.249289:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391220.249341:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.249352:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.249364:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391220.249388:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130761728:0@lo:101: 00000100:00100000:1.0:1790391220.249464:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.249538:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e34e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391220.252078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761728 00000100:00100000:2.0:1790391220.252092:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761728 00000100:00100000:2.0:1790391220.252158:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790391220.252169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+12:5833:x1877361130761728:12345-0@lo:101: 00010000:00010000:2.0:1790391220.252183:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391220.252203:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a6f7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.252243:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a6f7 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.252270:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a6f7 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.252280:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0a00, rc 0) 00000100:00100000:2.0:1790391220.252365:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130761728:12345-0@lo:101: Request processed in 198us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391220.252372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790391220.252437:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130761728:0@lo:101: 00010000:00010000:3.0:1790391220.252457:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391220.252469:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391220.252535:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130761856:0@lo:501: 00000100:00100000:3.0:1790391220.252570:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.252603:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.255068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761856 00000100:00100000:1.0:1790391220.255084:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761856 00000100:00100000:1.0:1790391220.255160:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790391220.255171:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130761856:12345-0@lo:501: 00000100:00100000:1.0:1790391220.255521:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130761856:12345-0@lo:501: Request processed in 352us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.255529:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790391220.255567:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130761856:0@lo:501: 00000100:00100000:3.0:1790391220.255629:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130761984:0@lo:503: 00000100:00100000:3.0:1790391220.274156:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.274209:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391220.274265:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130761984 00000100:00100000:2.0:1790391220.274276:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130761984 00000100:00100000:2.0:1790391220.274337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790391220.274347:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130761984:12345-0@lo:503: 00000100:00100000:2.0:1790391220.274565:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130761984:12345-0@lo:503: Request processed in 218us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391220.274573:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391220.274622:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130761984:0@lo:503: 00000100:00100000:3.0:1790391220.286796:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8476:1877361130762112:0@lo:502: 00000100:00100000:3.0:1790391220.286899:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.286957:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.287193:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130762112 00000100:00100000:1.0:1790391220.287201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130762112 00000100:00100000:1.0:1790391220.287262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790391220.287271:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:8476:x1877361130762112:12345-0@lo:502: 00000100:00100000:1.0:1790391220.287520:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+13:8476:x1877361130762112:12345-0@lo:502: Request processed in 249us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.287528:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790391220.288068:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8476:1877361130762112:0@lo:502: 00000100:00100000:3.0:1790391220.288132:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8476:1877361130762240:0@lo:502: 00000100:00100000:3.0:1790391220.288173:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.288205:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391220.288328:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130762240 00000100:00100000:2.0:1790391220.288334:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130762240 00000100:00100000:2.0:1790391220.288376:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790391220.288384:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:8476:x1877361130762240:12345-0@lo:502: 00000100:00100000:2.0:1790391220.288568:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:8476:x1877361130762240:12345-0@lo:502: Request processed in 183us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391220.288576:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790391220.288605:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8476:1877361130762240:0@lo:502: 00000040:00080000:0.0:1790391220.288641:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790391220.288830:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790391220.288848:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391220.288859:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.288870:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391220.288885:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1790391220.288888:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1790391220.288890:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790391220.288916:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.288923:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.288932:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391220.288944:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130762368:0@lo:101: 00000100:00100000:2.0:1790391220.288973:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.289000:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.289095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130762368 00000100:00100000:0.0:1790391220.289100:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130762368 00000100:00100000:0.0:1790391220.289122:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790391220.289129:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+13:5833:x1877361130762368:12345-0@lo:101: 00010000:00010000:0.0:1790391220.289136:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391220.289148:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400030800/0x35e94fc15449a70c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a705 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.289168:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030800/0x35e94fc15449a70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a705 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.289178:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400030800/0x35e94fc15449a70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a705 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.289186:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030800, rc 0) 00000100:00100000:0.0:1790391220.289215:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130762368:12345-0@lo:101: Request processed in 87us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.289221:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790391220.289848:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130762368:0@lo:101: 00010000:00010000:2.0:1790391220.289863:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.289872:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391220.289926:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130762496:0@lo:501: 00000100:00100000:2.0:1790391220.289955:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.289986:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.290046:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130762496 00000100:00100000:3.0:1790391220.290052:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130762496 00000100:00100000:3.0:1790391220.290077:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790391220.290083:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130762496:12345-0@lo:501: 00000100:00100000:3.0:1790391220.290327:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130762496:12345-0@lo:501: Request processed in 243us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.290335:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790391220.290420:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130762496:0@lo:501: 00000100:00100000:2.0:1790391220.290447:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130762624:0@lo:503: 00000100:00100000:2.0:1790391220.290488:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.290517:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.290557:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130762624 00000100:00100000:0.0:1790391220.290562:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130762624 00000100:00100000:0.0:1790391220.290603:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790391220.290621:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130762624:12345-0@lo:503: 00000100:00100000:0.0:1790391220.290780:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130762624:12345-0@lo:503: Request processed in 170us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.290787:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790391220.290871:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130762624:0@lo:503: 00000100:00100000:2.0:1790391220.291221:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8477:1877361130762752:0@lo:502: 00000100:00100000:2.0:1790391220.291257:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.291286:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.291311:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130762752 00000100:00100000:1.0:1790391220.291316:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130762752 00000100:00100000:1.0:1790391220.291352:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790391220.291360:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:8477:x1877361130762752:12345-0@lo:502: 00000100:00100000:1.0:1790391220.291522:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+14:8477:x1877361130762752:12345-0@lo:502: Request processed in 162us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.291529:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790391220.291644:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8477:1877361130762752:0@lo:502: 00000020:01000000:2.0:1790391220.291666:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391220.291674:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391220.291677:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391220.291681:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790391220.291702:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8477:1877361130762880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391220.291732:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.291762:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.292418:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130762880 00000100:00100000:3.0:1790391220.292425:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130762880 00000100:00100000:3.0:1790391220.292483:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790391220.292492:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:8477:x1877361130762880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391220.292697:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+14:8477:x1877361130762880:12345-0@lo:502:llog_process_th.0 Request processed in 207us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.292705:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790391220.293072:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8477:1877361130762880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391220.293101:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391220.293107:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391220.293109:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391220.293114:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1790391220.293345:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1790391220.293364:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790391220.293374:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.293384:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391220.293393:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790391220.293395:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962439f98800 from 39 10000000:01000000:0.0:1790391220.293398:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790391220.293428:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.293436:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.293445:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391220.293464:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391220.293520:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391220.293554:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391220.293598:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763008 00000100:00100000:2.0:1790391220.293603:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763008 00000100:00100000:2.0:1790391220.293650:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790391220.293658:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:5833:x1877361130763008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391220.293667:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391220.293678:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a1800/0x35e94fc15449a71a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a713 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.293712:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a1800/0x35e94fc15449a71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a713 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.293722:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a1800/0x35e94fc15449a71a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a713 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.293731:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a1800, rc 0) 00000100:00100000:2.0:1790391220.293777:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130763008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391220.293783:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790391220.293999:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391220.294043:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.294052:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391220.294097:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391220.294129:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391220.294158:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.296953:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763136 00000100:00100000:1.0:1790391220.296967:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763136 00000100:00100000:1.0:1790391220.297055:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790391220.297067:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130763136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.297358:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130763136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.297365:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790391220.297981:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391220.298054:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391220.298119:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391220.298156:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.298404:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763264 00000100:00100000:1.0:1790391220.298410:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763264 00000100:00100000:1.0:1790391220.298453:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790391220.298462:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130763264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.298664:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130763264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.298671:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790391220.299397:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391220.300409:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8478:1877361130763392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391220.300478:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.300516:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff962406a79180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.300926:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763392 00000100:00100000:1.0:1790391220.300933:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763392 00000100:00100000:1.0:1790391220.300978:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790391220.300987:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:8478:x1877361130763392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391220.301248:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:8478:x1877361130763392:12345-0@lo:502:llog_process_th.0 Request processed in 261us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.301263:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790391220.301379:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8478:1877361130763392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391220.301422:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8478:1877361130763520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391220.301461:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391220.301489:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391220.301563:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763520 00000100:00100000:2.0:1790391220.301569:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763520 00000100:00100000:2.0:1790391220.301595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790391220.301603:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+15:8478:x1877361130763520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391220.301781:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+15:8478:x1877361130763520:12345-0@lo:502:llog_process_th.0 Request processed in 178us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391220.301788:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790391220.302074:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8478:1877361130763520:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790391220.302093:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790391220.302414:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790391220.302431:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391220.302441:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.302451:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391220.302460:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790391220.302462:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1790391220.302472:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790391220.302498:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.302505:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.302514:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391220.302529:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.302562:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.302589:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.304428:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763648 00000100:00100000:1.0:1790391220.304445:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763648 00000100:00100000:1.0:1790391220.304500:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790391220.304510:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+15:5833:x1877361130763648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391220.304525:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391220.304543:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e30200/0x35e94fc15449a728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a721 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.304570:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e30200/0x35e94fc15449a728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a721 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.304581:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e30200/0x35e94fc15449a728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a721 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.304591:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30200, rc 0) 00000100:00100000:1.0:1790391220.304675:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130763648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.304683:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790391220.305119:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391220.305140:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.305151:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391220.305231:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.305273:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.305315:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.306054:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763776 00000100:00100000:3.0:1790391220.306062:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763776 00000100:00100000:3.0:1790391220.306109:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790391220.306117:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130763776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391220.306395:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130763776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.306411:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790391220.306421:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.306466:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.306509:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.306544:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391220.306573:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130763904 00000100:00100000:2.0:1790391220.306577:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130763904 00000100:00100000:2.0:1790391220.306597:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790391220.306604:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130763904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.306774:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130763904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391220.306781:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790391220.307496:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130763904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.308630:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8479:1877361130764032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391220.308697:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.308738:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.308797:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764032 00000100:00100000:3.0:1790391220.308804:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764032 00000100:00100000:3.0:1790391220.308847:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790391220.308856:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:8479:x1877361130764032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391220.309076:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+16:8479:x1877361130764032:12345-0@lo:502:llog_process_th.0 Request processed in 222us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.309083:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790391220.309204:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8479:1877361130764032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391220.309230:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391220.309244:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391220.309247:0:8479:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790391220.309252:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790391220.309274:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8479:1877361130764160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391220.309307:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391220.309324:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.309385:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764160 00000100:00100000:1.0:1790391220.309389:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764160 00000100:00100000:1.0:1790391220.309422:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790391220.309429:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:8479:x1877361130764160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391220.309543:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:8479:x1877361130764160:12345-0@lo:502:llog_process_th.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.309555:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790391220.309691:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8479:1877361130764160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391220.309708:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391220.309712:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391220.309714:0:8479:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790391220.309718:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1790391220.311484:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1790391220.311515:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790391220.311526:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.311539:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391220.311551:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391220.311554:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9624081bf000 from 39 10000000:01000000:1.0:1790391220.311557:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391220.311593:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.311601:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.311621:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391220.311645:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.311698:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.311737:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.311942:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764288 00000100:00100000:0.0:1790391220.311949:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764288 00000100:00100000:0.0:1790391220.311997:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790391220.312007:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130764288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391220.312038:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391220.312050:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031000/0x35e94fc15449a736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a72f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.312075:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031000/0x35e94fc15449a736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a72f expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.312085:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031000/0x35e94fc15449a736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a72f expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.312093:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031000, rc 0) 00000100:00100000:0.0:1790391220.312131:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130764288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.312138:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790391220.312293:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391220.312311:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.312331:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391220.312559:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.312587:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.312628:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.312682:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764416 00000100:00100000:3.0:1790391220.312687:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764416 00000100:00100000:3.0:1790391220.312723:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790391220.312731:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130764416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391220.312967:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130764416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.312974:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790391220.313563:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.313602:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.313661:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.313691:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.313742:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764544 00000100:00100000:3.0:1790391220.313747:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764544 00000100:00100000:3.0:1790391220.313784:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790391220.313792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130764544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391220.315494:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130764544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1695us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.315506:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790391220.319228:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391220.319746:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8480:1877361130764672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391220.319818:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.319859:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624090b5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.319912:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764672 00000100:00100000:0.0:1790391220.319919:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764672 00000100:00100000:0.0:1790391220.319962:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790391220.319971:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:8480:x1877361130764672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391220.320270:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:8480:x1877361130764672:12345-0@lo:502:llog_process_th.0 Request processed in 297us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.320279:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391220.320571:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8480:1877361130764672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391220.320624:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8480:1877361130764800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391220.320657:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391220.320686:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624090b5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.320778:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764800 00000100:00100000:0.0:1790391220.320783:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764800 00000100:00100000:0.0:1790391220.320820:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790391220.320827:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:8480:x1877361130764800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391220.320963:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:8480:x1877361130764800:12345-0@lo:502:llog_process_th.0 Request processed in 135us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.320970:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790391220.321061:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8480:1877361130764800:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790391220.321080:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790391220.321291:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790391220.321310:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391220.321320:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.321331:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391220.321341:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790391220.321343:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790391220.321346:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790391220.321527:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.321543:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391220.321554:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391220.321570:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391220.321599:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391220.321634:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.321673:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130764928 00000100:00100000:3.0:1790391220.321678:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130764928 00000100:00100000:3.0:1790391220.321711:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790391220.321718:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130764928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391220.321726:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391220.321738:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3400/0x35e94fc15449a744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a73d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391220.321757:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3400/0x35e94fc15449a744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a73d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391220.321766:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3400/0x35e94fc15449a744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a73d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391220.321774:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3400, rc 0) 00000100:00100000:3.0:1790391220.321808:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130764928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.321813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790391220.321876:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130764928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391220.321888:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.321896:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391220.321940:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439942680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.321965:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.321986:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.322056:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130765056 00000100:00100000:0.0:1790391220.322060:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130765056 00000100:00100000:0.0:1790391220.322084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391220.322090:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130765056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391220.322308:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130765056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.322314:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790391220.322865:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439942680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.322916:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.322958:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.322992:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f672540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.324338:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130765184 00000100:00100000:0.0:1790391220.324348:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130765184 00000100:00100000:0.0:1790391220.324390:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790391220.324399:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130765184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391220.324597:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130765184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.324605:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790391220.324702:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.326852:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8481:1877361130765312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391220.326924:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.326968:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f672300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.327049:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130765312 00000100:00100000:3.0:1790391220.327056:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130765312 00000100:00100000:3.0:1790391220.327095:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790391220.327104:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:8481:x1877361130765312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391220.327333:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:8481:x1877361130765312:12345-0@lo:502:llog_process_th.0 Request processed in 231us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.327341:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790391220.327552:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8481:1877361130765312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391220.327577:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391220.327585:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391220.327587:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391220.327592:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790391220.327624:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8481:1877361130765440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391220.327656:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.327683:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f672300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391220.327869:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130765440 00000100:00100000:0.0:1790391220.327874:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130765440 00000100:00100000:0.0:1790391220.327918:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790391220.327933:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8481:x1877361130765440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391220.328121:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8481:x1877361130765440:12345-0@lo:502:llog_process_th.0 Request processed in 189us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391220.328128:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790391220.328517:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8481:1877361130765440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391220.328540:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391220.328550:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391220.328551:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391220.328555:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1790391220.331069:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1790391220.331102:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790391220.331114:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.331146:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391220.331158:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790391220.331160:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962427f099c0 from 1 10000000:01000000:1.0:1790391220.331163:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391220.331199:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.331207:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391220.331217:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391220.331241:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.331302:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391220.331338:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15be40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391220.331466:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130765568 00000100:00100000:3.0:1790391220.331475:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130765568 00000100:00100000:3.0:1790391220.331528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790391220.331537:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130765568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391220.331551:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391220.331564:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2600/0x35e94fc15449a752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a74b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391220.331588:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2600/0x35e94fc15449a752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a74b expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391220.331598:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2600/0x35e94fc15449a752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a74b expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391220.331616:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2600, rc 0) 00000100:00100000:3.0:1790391220.331652:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130765568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391220.331658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790391220.331812:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391220.331829:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a752 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.331838:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a752 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391220.331885:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391220.331911:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391220.331935:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243f672300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391220.331982:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130765696 00000100:00100000:1.0:1790391220.331986:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130765696 00000100:00100000:1.0:1790391220.332011:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790391220.332045:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130765696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391220.332230:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130765696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (317us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391220.332236:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790391220.332374:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130765696:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1790391220.332396:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790391220.332401:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a752 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391220.332409:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a752 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391220.492858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391220.492901:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391220.492938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391220.492958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391220.493067:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717952 00000100:00100000:1.0:1790391220.493077:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717952 00000100:00100000:1.0:1790391220.493137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:1.0:1790391220.493161:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108717952:12345-192.168.201.8@tcp:400: 00000100:00100000:1.0:1790391220.493234:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108717952:12345-192.168.201.8@tcp:400: Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.493242:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:1.0:1790391220.493264:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718080 00000100:00100000:1.0:1790391220.493268:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718080 00000100:00100000:1.0:1790391220.493292:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718208 00000100:00100000:1.0:1790391220.493295:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718208 00000100:00100000:1.0:1790391220.493311:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:1.0:1790391220.493318:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2364:x1877361108718080:12345-192.168.201.8@tcp:400: 00000100:00100000:1.0:1790391220.493344:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2364:x1877361108718080:12345-192.168.201.8@tcp:400: Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.493350:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:1.0:1790391220.493361:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391220.493367:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2364:x1877361108718208:12345-192.168.201.8@tcp:400: 00000100:00100000:1.0:1790391220.493389:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2364:x1877361108718208:12345-192.168.201.8@tcp:400: Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.493395:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391220.493493:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108717824 00000100:00100000:1.0:1790391220.493498:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108717824 00000100:00100000:1.0:1790391220.493520:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 163 00000100:00100000:1.0:1790391220.493527:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+8:2364:x1877361108717824:12345-192.168.201.8@tcp:400: 00000100:00100000:1.0:1790391220.493553:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+8:2364:x1877361108717824:12345-192.168.201.8@tcp:400: Request processed in 27us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391220.493560:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 163 00000100:00080000:0.0:1790391220.493722:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391220.493727:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391220.493730:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391220.569319:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391221.593276:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391222.171568:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391222.171604:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130765824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391222.171679:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391222.171933:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130765824 00000100:00100000:1.0:1790391222.171943:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130765824 00000100:00100000:1.0:1790391222.172040:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391222.172052:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130765824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391222.172091:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391222.172149:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130765824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391222.172156:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1790391222.172224:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391222.172359:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439941180 x1877361130765824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391222.172381:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130765824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391222.618267:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391223.565617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391223.565715:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718336 00000100:00100000:3.0:1790391223.565726:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718336 00000100:00100000:3.0:1790391223.565786:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 164 00000100:00100000:3.0:1790391223.565812:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+8:5605:x1877361108718336:12345-192.168.201.8@tcp:101: 00010000:00010000:3.0:1790391223.565829:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391223.565846:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2400/0x35e94fc15449a759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fbf7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391223.565875:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2400/0x35e94fc15449a759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbf7 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391223.565887:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2400/0x35e94fc15449a759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbf7 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391223.565896:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2400, rc 0) 00000100:00100000:3.0:1790391223.565954:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5605:x1877361108718336:12345-192.168.201.8@tcp:101: Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391223.565960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 164 00000100:00100000:0.0:1790391223.577774:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391223.577848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718464 00000100:00100000:3.0:1790391223.577857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718464 00000100:00100000:3.0:1790391223.577911:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 165 00000100:00100000:3.0:1790391223.577922:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5605:x1877361108718464:12345-192.168.201.8@tcp:501: 00000100:00100000:3.0:1790391223.578270:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5605:x1877361108718464:12345-192.168.201.8@tcp:501: Request processed in 348us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391223.578277:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 165 00000100:00100000:1.0:1790391223.582118:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391223.582394:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718592 00000100:00100000:3.0:1790391223.582404:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718592 00000100:00100000:3.0:1790391223.582465:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 166 00000100:00100000:3.0:1790391223.582476:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5605:x1877361108718592:12345-192.168.201.8@tcp:503: 00000100:00100000:3.0:1790391223.582718:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5605:x1877361108718592:12345-192.168.201.8@tcp:503: Request processed in 243us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391223.582733:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 166 00000100:00100000:0.0:1790391223.600515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391223.600763:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718720 00000100:00100000:1.0:1790391223.600773:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718720 00000100:00100000:1.0:1790391223.600826:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00100000:1.0:1790391223.600847:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+9:6094:x1877361108718720:12345-192.168.201.8@tcp:502: 00000100:00100000:1.0:1790391223.601304:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+9:6094:x1877361108718720:12345-192.168.201.8@tcp:502: Request processed in 458us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391223.601313:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00100000:1.0:1790391223.608427:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391223.608517:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718848 00000100:00100000:0.0:1790391223.608527:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718848 00000100:00100000:0.0:1790391223.608617:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 168 00000100:00100000:0.0:1790391223.608627:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:6094:x1877361108718848:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391223.609076:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:6094:x1877361108718848:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 450us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391223.609085:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 168 00000100:00100000:2.0:1790391223.611897:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391223.611986:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108718976 00000100:00100000:3.0:1790391223.612005:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108718976 00000100:00100000:3.0:1790391223.612097:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 169 00000100:00100000:3.0:1790391223.612108:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5605:x1877361108718976:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391223.612123:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391223.612139:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3000/0x35e94fc15449a760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fbfe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391223.612174:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3000/0x35e94fc15449a760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbfe expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391223.612186:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3000/0x35e94fc15449a760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbfe expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391223.612195:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3000, rc 0) 00000100:00100000:3.0:1790391223.612250:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108718976:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 144us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391223.612256:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 169 00000100:00100000:2.0:1790391223.619417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391223.619510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108719104 00000100:00100000:1.0:1790391223.619520:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108719104 00000100:00100000:1.0:1790391223.619588:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 170 00000100:00100000:1.0:1790391223.619599:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108719104:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391223.619870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108719104:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 272us (460us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391223.619878:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 170 00010000:00010000:1.0:1790391223.643495:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391224.665476:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790391225.136498:0:8518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff21357b40 20000000:00000080:3.0:1790391225.136517:0:8518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96243f6be800 uarg=0000000000000000 20000000:01000000:3.0:1790391225.136564:0:8518:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790391225.136570:0:8518:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790391225.136575:0:8518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790391225.137542:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1790391225.137697:0:8518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1790391225.142989:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1790391225.143472:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1790391225.143548:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1790391225.143577:0:8518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790391225.143596:0:8518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143613:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e30400/0x35e94fc15449a529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a522 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143621:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a576 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143628:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a602 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143638:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143646:0:8518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143684:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143700:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 9 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.143714:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130765952:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391225.143827:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a602 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143835:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a602 expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.143863:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130766080:0@lo:104: 00000100:00100000:3.0:1790391225.143902:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391225.143948:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a576 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.143958:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a576 expref: 18 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.143966:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130766208:0@lo:104: 00000100:00100000:3.0:1790391225.143993:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391225.144044:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e30400/0x35e94fc15449a529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a522 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391225.144053:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962415e30400/0x35e94fc15449a529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a522 expref: 18 pid: 5829 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.144062:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130766336:0@lo:104: 00000100:00100000:3.0:1790391225.144085:0:8518:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391225.145406:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790391225.145434:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391225.145462:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766080 00000100:00100000:2.0:1790391225.145469:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766080 00000100:00100000:2.0:1790391225.145506:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766208 00000100:00100000:2.0:1790391225.145509:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766208 00000100:00100000:2.0:1790391225.145519:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766336 00000100:00100000:2.0:1790391225.145521:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766336 00000100:00100000:2.0:1790391225.145546:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391225.145555:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:8518:x1877361130766080:12345-0@lo:104: 00010000:00010000:2.0:1790391225.145570:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145639:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391225.145645:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:8518:x1877361130766080:12345-0@lo:104: Request processed in 92us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.145651:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391225.145668:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391225.145674:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:8518:x1877361130766208:12345-0@lo:104: 00010000:00010000:2.0:1790391225.145682:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145716:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391225.145721:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:8518:x1877361130766208:12345-0@lo:104: Request processed in 48us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.145727:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391225.145756:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391225.145762:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:8518:x1877361130766336:12345-0@lo:104: 00010000:00010000:2.0:1790391225.145770:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145807:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790391225.145812:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:8518:x1877361130766336:12345-0@lo:104: Request processed in 51us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.145818:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1790391225.145836:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790391225.145841:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145848:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391225.145852:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145860:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391225.145867:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391225.145872:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391225.145903:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145910:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391225.145930:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145937:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962400031600/0x35e94fc15449a602 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a609 expref: -99 pid: 7641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145960:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391225.145964:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145970:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412d8fe00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391225.145973:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.145981:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391225.145988:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391225.145994:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391225.146007:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.146037:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391225.146053:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.146061:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8fe00/0x35e94fc15449a576 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a57d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.146071:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391225.146074:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.146091:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391225.146094:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.146102:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391225.146109:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391225.146115:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391225.146127:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.147460:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391225.147477:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.147485:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449a522 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a529 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.147510:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391225.147512:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391225.147514:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391225.147559:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130766464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391225.147610:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391225.147667:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130766592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391225.147691:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391225.147724:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391225.147730:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130766720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391225.147750:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391225.147794:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766464 00000100:00100000:2.0:1790391225.147801:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766464 00010000:00010000:2.0:1790391225.147828:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a602 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391225.147845:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766592 00000100:00100000:2.0:1790391225.147848:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766592 00010000:00010000:2.0:1790391225.147859:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a576 expref: 20 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391225.147869:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766720 00000100:00100000:2.0:1790391225.147871:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766720 00010000:00010000:2.0:1790391225.147881:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e30400/0x35e94fc15449a529 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a522 expref: 21 pid: 5829 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391225.147893:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391225.147900:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+21:3308:x1877361130766464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391225.147912:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391225.147917:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a602 expref: 21 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.147928:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a602 expref: 21 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.147945:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391225.147976:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+21:3308:x1877361130766464:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.147984:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391225.148006:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391225.148033:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+20:3309:x1877361130766592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391225.148042:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391225.148047:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a576 expref: 20 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.148055:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a576 expref: 20 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.148064:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391225.148089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+20:3309:x1877361130766592:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.148095:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391225.148108:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391225.148113:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130766720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391225.148121:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391225.148125:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e30400/0x35e94fc15449a529 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a522 expref: 19 pid: 5829 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.148595:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e30400/0x35e94fc15449a529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a522 expref: 19 pid: 5829 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.148607:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391225.148634:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130766720:12345-0@lo:103:ldlm_bl.0 Request processed in 520us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.148641:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391225.148688:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130766464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391225.148713:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130766720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391225.148732:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130766592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391225.150545:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391225.151615:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400031c00/0x35e94fc15449a609 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a602 expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.151636:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130766080:0@lo:104: 00010000:00010000:3.0:1790391225.151649:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a1e00/0x35e94fc15449a57d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a576 expref: 17 pid: 5830 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.151658:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130766208:0@lo:104: 00010000:00010000:3.0:1790391225.151669:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e30400/0x35e94fc15449a529 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a522 expref: 16 pid: 5829 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.151693:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130766336:0@lo:104: 00000100:00100000:2.0:1790391225.152438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391225.152497:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108719232 00000100:00100000:0.0:1790391225.152505:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108719232 00010000:00010000:0.0:1790391225.152559:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 10 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391225.152596:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:0.0:1790391225.152605:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2364:x1877361108719232:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391225.152618:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391225.152628:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 10 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152639:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 10 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152660:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152669:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152684:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152691:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152699:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152706:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152712:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391225.152721:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152730:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152740:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391225.152751:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391225.153069:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2364:x1877361108719232:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 408us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391225.153079:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00010000:00010000:3.0:1790391225.153403:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8e200/0x35e94fc15449a6c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbc6 expref: 9 pid: 5830 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391225.153417:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1877361130765952:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391225.153446:0:8518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.153526:0:8518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.153543:0:8518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391225.153550:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3600/0x35e94fc15449a767 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391225.244224:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130766848:0@lo:400:kworker.0 00000100:00100000:0.0:1790391225.244285:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391225.244434:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130766976:0@lo:400:kworker.0 00000100:00100000:2.0:1790391225.244464:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391225.244942:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130767360:0@lo:400:kworker.0 00000100:00100000:0.0:1790391225.244982:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391225.245346:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766976 00000100:00100000:1.0:1790391225.245354:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766976 00000100:00100000:1.0:1790391225.245400:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130767360 00000100:00100000:1.0:1790391225.245402:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130767360 00000100:00100000:1.0:1790391225.245416:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391225.245424:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130766976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391225.245471:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130766976:12345-0@lo:400:kworker.0 Request processed in 47us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391225.245477:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391225.245490:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391225.245495:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130767360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391225.245514:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130767360:12345-0@lo:400:kworker.0 Request processed in 20us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391225.245520:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790391225.245648:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f38e00 x1877361130767360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391225.245662:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130767360:0@lo:400:kworker.0 00000100:00100000:0.0:1790391225.245684:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130766848 00000100:00100000:0.0:1790391225.245687:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130766848 00000100:00100000:0.0:1790391225.245718:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391225.245724:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130766848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391225.245755:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130766848:12345-0@lo:400:kworker.0 Request processed in 31us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391225.245770:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790391225.245791:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391225.245794:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391225.246449:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130766848:0@lo:400:kworker.0 00010000:00080000:2.0:1790391225.246683:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f38000 x1877361130766976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391225.246694:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130766976:0@lo:400:kworker.0 00000100:00100000:2.0:1790391225.246703:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130767488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391225.246732:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391225.246779:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130767104:0@lo:400:kworker.0 00000100:00100000:2.0:1790391225.246800:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391225.246816:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391225.246821:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130767232:0@lo:400:kworker.0 00000100:00100000:2.0:1790391225.246836:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391225.246931:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130767488 00000100:00100000:1.0:1790391225.246936:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130767488 00000100:00100000:1.0:1790391225.246965:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391225.246971:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130767488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391225.247000:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391225.247049:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130767488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391225.247055:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391225.247281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130767104 00000100:00100000:2.0:1790391225.247285:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130767104 00000100:00100000:2.0:1790391225.247312:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130767232 00000100:00100000:2.0:1790391225.247320:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130767232 00000100:00100000:2.0:1790391225.247337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391225.247342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130767104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391225.247372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130767104:12345-0@lo:400:kworker.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.247378:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391225.247390:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391225.247396:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130767232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391225.247417:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130767232:12345-0@lo:400:kworker.0 Request processed in 22us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.247422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1790391225.247450:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f39880 x1877361130767488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391225.247465:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130767488:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790391225.247478:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391225.247492:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130767232:0@lo:400:kworker.0 00000100:00100000:2.0:1790391225.247500:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130767104:0@lo:400:kworker.0 00000100:00100000:0.0:1790391225.612929:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391225.613292:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391225.613313:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391225.613350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391225.613389:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108719616 00000100:00100000:0.0:1790391225.613401:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108719616 00000100:00100000:0.0:1790391225.613467:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108719744 00000100:00100000:0.0:1790391225.613470:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108719744 00000100:00100000:0.0:1790391225.613490:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1790391225.613501:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108719616:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391225.613582:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108719616:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391225.613590:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1790391225.613608:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:0.0:1790391225.613615:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108719744:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391225.613644:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108719744:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391225.613650:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:3.0:1790391225.614611:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108719360 00000100:00100000:3.0:1790391225.614621:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108719360 00000100:00100000:3.0:1790391225.614686:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:3.0:1790391225.614703:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:2366:x1877361108719360:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391225.614750:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:2366:x1877361108719360:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 56us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391225.614756:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:2.0:1790391225.614866:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108719488 00000100:00100000:2.0:1790391225.614872:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108719488 00000100:00100000:2.0:1790391225.614917:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:2.0:1790391225.614924:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108719488:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391225.614967:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108719488:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 44us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391225.614974:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00080000:2.0:1790391225.614995:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391225.615053:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391225.615056:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391225.689260:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391226.701905:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391226.702471:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108719872 00000100:00100000:2.0:1790391226.702482:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108719872 00000100:00100000:2.0:1790391226.702543:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00100000:2.0:1790391226.702553:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+9:5605:x1877361108719872:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391226.702577:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391226.702596:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc05 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391226.702622:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391226.702632:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391226.702641:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0200, rc 0) 00000100:00100000:2.0:1790391226.702698:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108719872:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 146us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391226.702704:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00100000:3.0:1790391226.706125:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391226.706572:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720000 00000100:00100000:1.0:1790391226.706584:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720000 00000100:00100000:1.0:1790391226.706646:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 173 00000100:00100000:1.0:1790391226.706656:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108720000:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391226.706949:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108720000:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 294us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391226.706957:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 173 00010000:00010000:2.0:1790391226.713526:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391226.721207:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391226.721369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720128 00000100:00100000:1.0:1790391226.721379:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720128 00000100:00100000:1.0:1790391226.721436:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 174 00000100:00100000:1.0:1790391226.721445:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108720128:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391226.722080:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:5605:x1877361108720128:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 633us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391226.722088:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 174 00000100:00100000:3.0:1790391226.726601:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391226.728962:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720256 00000100:00100000:1.0:1790391226.728978:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720256 00000100:00100000:1.0:1790391226.729056:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 175 00000100:00100000:1.0:1790391226.729067:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:6151:x1877361108720256:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391226.729341:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:6151:x1877361108720256:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 275us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391226.729349:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 175 00000100:00100000:3.0:1790391226.739958:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391226.740121:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720384 00000100:00100000:1.0:1790391226.740132:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720384 00000100:00100000:1.0:1790391226.740182:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 176 00000100:00100000:1.0:1790391226.740194:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:6151:x1877361108720384:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391226.740461:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:6151:x1877361108720384:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 268us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391226.740468:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 176 10000000:01000000:1.0:1790391227.043094:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391227.043101:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96243f8f8000 from 4 10000000:01000000:1.0:1790391227.043106:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391227.043145:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.043157:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.043168:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391227.043191:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130767616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.043253:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.043388:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.049418:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130767616 00000100:00100000:3.0:1790391227.049430:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130767616 00000100:00100000:3.0:1790391227.049493:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790391227.049515:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130767616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391227.049531:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391227.049549:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a775 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.049586:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a775 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.049597:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a775 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.049608:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3c00, rc 0) 00000100:00100000:3.0:1790391227.049677:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130767616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (6424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.049684:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790391227.049741:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130767616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391227.049757:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.049767:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391227.049830:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130767744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.049864:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.049887:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130767744 00000100:00100000:3.0:1790391227.049891:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130767744 00000100:00100000:3.0:1790391227.049912:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790391227.049918:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130767744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.050162:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130767744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.050169:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790391227.050211:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408213480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.050222:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130767744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.050249:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130767872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.050287:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.050434:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130767872 00000100:00100000:3.0:1790391227.050438:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130767872 00000100:00100000:3.0:1790391227.050461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790391227.050467:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130767872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.050608:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130767872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.050615:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790391227.050644:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408213480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.050656:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130767872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391227.057608:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8578:1877361130768000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391227.057692:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391227.057784:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.061863:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768000 00000100:00100000:3.0:1790391227.061875:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768000 00000100:00100000:3.0:1790391227.061936:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1790391227.061947:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:8578:x1877361130768000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391227.062228:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:8578:x1877361130768000:12345-0@lo:502:llog_process_th.0 Request processed in 282us (4535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.062236:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790391227.063451:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8578:1877361130768000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391227.063492:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391227.063513:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.063516:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790391227.063525:0:8578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96243f8f8000 00000020:00000080:1.0:1790391227.063527:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790391227.063618:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8578:1877361130768128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.063680:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.063714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768128 00000100:00100000:1.0:1790391227.063719:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768128 00000100:00100000:1.0:1790391227.063753:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790391227.063760:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:8578:x1877361130768128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.063930:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:8578:x1877361130768128:12345-0@lo:502:llog_process_th.0 Request processed in 169us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.063946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790391227.063992:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.064007:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8578:1877361130768128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391227.064046:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391227.064051:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.064053:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790391227.064057:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790391227.067291:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790391227.070442:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391227.070454:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.070467:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391227.070486:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391227.070488:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962439f98800 from 4 10000000:01000000:3.0:1790391227.070491:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391227.070536:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.070545:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.070558:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391227.070583:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.070655:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.070708:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768256 00000100:00100000:3.0:1790391227.070715:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768256 00000100:00100000:3.0:1790391227.070759:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790391227.070768:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130768256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391227.070779:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391227.070790:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a783 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.070812:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a783 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.070823:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a783 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.070832:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2800, rc 0) 00000100:00100000:3.0:1790391227.070870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130768256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.070877:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790391227.070923:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408213a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.070944:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391227.070958:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.070968:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391227.071032:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.071056:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.071075:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768384 00000100:00100000:3.0:1790391227.071079:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768384 00000100:00100000:3.0:1790391227.071100:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790391227.071106:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130768384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391227.072109:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7f480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.073141:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130768384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2028us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.073151:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790391227.073214:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.073261:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391227.078657:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.078713:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7f480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.079331:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768512 00000100:00100000:1.0:1790391227.079342:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768512 00000100:00100000:1.0:1790391227.079395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790391227.079404:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130768512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.079638:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130768512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.079647:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790391227.085614:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.089636:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8582:1877361130768640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.089724:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.089763:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768640 00000100:00100000:1.0:1790391227.089770:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768640 00000100:00100000:1.0:1790391227.089809:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790391227.089819:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8582:x1877361130768640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.090040:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:8582:x1877361130768640:12345-0@lo:502:llog_process_th.0 Request processed in 197us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.090048:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790391227.090365:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397b3780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.090390:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8582:1877361130768640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391227.090428:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391227.090438:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.090440:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790391227.090448:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962439f98800 00000020:00000080:1.0:1790391227.090451:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391227.091146:0:8582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8582:1877361130768768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391227.091197:0:8582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391227.091221:0:8582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.094189:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768768 00000100:00100000:1.0:1790391227.094207:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768768 00000100:00100000:1.0:1790391227.095164:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790391227.095180:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:8582:x1877361130768768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.095451:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:8582:x1877361130768768:12345-0@lo:502:llog_process_th.0 Request processed in 275us (4252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.095459:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790391227.100605:0:8582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8582:1877361130768768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391227.100644:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391227.100653:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391227.100655:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790391227.100669:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790391227.109125:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790391227.109164:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391227.109177:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.109191:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391227.109204:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391227.109207:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9624081bf000 from 4 10000000:01000000:1.0:1790391227.109210:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391227.109252:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.109262:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.109274:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391227.110417:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.110489:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.110540:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130768896 00000100:00100000:1.0:1790391227.110547:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130768896 00000100:00100000:1.0:1790391227.110595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790391227.110605:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130768896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391227.110619:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391227.110633:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a791 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.111402:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a791 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.111419:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a791 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.111429:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31600, rc 0) 00000100:00100000:1.0:1790391227.111475:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130768896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 872us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.111483:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790391227.111544:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.111570:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130768896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391227.111586:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.111596:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391227.112055:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130769024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.112092:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.112119:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769024 00000100:00100000:1.0:1790391227.112125:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769024 00000100:00100000:1.0:1790391227.112154:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790391227.112161:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130769024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.113939:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130769024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1772us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.113952:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790391227.114009:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.114048:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130769024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.114095:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130769152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.114141:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.114166:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.114181:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769152 00000100:00100000:1.0:1790391227.114187:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769152 00000100:00100000:1.0:1790391227.114220:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790391227.114228:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130769152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.115922:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130769152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1686us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.115935:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790391227.116032:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130769152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391227.116227:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8586:1877361130769280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.116278:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391227.121112:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.121190:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769280 00000100:00100000:1.0:1790391227.121201:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769280 00000100:00100000:1.0:1790391227.121290:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790391227.121359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:8586:x1877361130769280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.121608:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:8586:x1877361130769280:12345-0@lo:502:llog_process_th.0 Request processed in 252us (5329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.121616:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1790391227.124471:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8586:1877361130769280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391227.124527:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391227.124539:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391227.124542:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790391227.124549:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9624081bf000 00000020:00000080:0.0:1790391227.124552:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391227.124652:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8586:1877361130769408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391227.124796:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391227.124832:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.126779:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769408 00000100:00100000:1.0:1790391227.126795:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769408 00000100:00100000:1.0:1790391227.126858:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1790391227.126868:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:8586:x1877361130769408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391227.127149:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:8586:x1877361130769408:12345-0@lo:502:llog_process_th.0 Request processed in 282us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.127158:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1790391227.127247:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:8586:1877361130769408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391227.127281:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391227.127288:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.127290:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790391227.128417:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790391227.128483:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790391227.128512:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391227.128524:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.128536:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391227.289622:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391227.289645:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130769536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391227.289713:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.289811:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769536 00000100:00100000:1.0:1790391227.289820:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769536 00000100:00100000:1.0:1790391227.289881:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391227.289893:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130769536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391227.289929:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391227.289975:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130769536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.289983:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1790391227.291047:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391227.291088:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439942300 x1877361130769536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391227.291122:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130769536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790391227.738027:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391228.761403:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391229.786574:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391230.361462:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130769792:0@lo:400:kworker.0 00000100:00100000:0.0:1790391230.361530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391230.361579:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130770304:0@lo:400:kworker.0 00000100:00100000:0.0:1790391230.361603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391230.361633:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391230.361640:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130769920:0@lo:400:kworker.0 00000100:00100000:0.0:1790391230.361664:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391230.361696:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770304 00000100:00100000:0.0:1790391230.361709:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770304 00000100:00100000:0.0:1790391230.361759:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769920 00000100:00100000:0.0:1790391230.361762:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769920 00000100:00100000:0.0:1790391230.361779:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391230.361787:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130770304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391230.361836:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130770304:12345-0@lo:400:kworker.0 Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391230.361843:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391230.361859:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790391230.361865:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130769920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391230.361892:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130769920:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391230.361898:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790391230.361937:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f1a680 x1877361130769920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391230.361950:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130769920:0@lo:400:kworker.0 00010000:00080000:0.0:1790391230.361959:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f1b480 x1877361130770304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391230.361967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130770304:0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362154:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130769664:0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391230.362219:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130770176:0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362372:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391230.362398:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391230.362404:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130770048:0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362425:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391230.362467:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769792 00000100:00100000:2.0:1790391230.362471:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769792 00000100:00100000:2.0:1790391230.362501:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770176 00000100:00100000:2.0:1790391230.362504:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770176 00000100:00100000:2.0:1790391230.362518:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770048 00000100:00100000:2.0:1790391230.362520:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770048 00000100:00100000:2.0:1790391230.362533:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790391230.362539:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130769792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362578:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130769792:12345-0@lo:400:kworker.0 Request processed in 39us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.362585:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790391230.362598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790391230.362603:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130770176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362633:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130770176:12345-0@lo:400:kworker.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.362639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790391230.362649:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391230.362655:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130770048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362678:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130770048:12345-0@lo:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.362684:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391230.362700:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130769664 00000100:00100000:2.0:1790391230.362703:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130769664 00000100:00100000:2.0:1790391230.362726:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790391230.362732:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130769664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362769:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130769664:12345-0@lo:400:kworker.0 Request processed in 37us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.362775:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1790391230.362827:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130770048:0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362836:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130769664:0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362844:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130770176:0@lo:400:kworker.0 00000100:00100000:2.0:1790391230.362866:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130769792:0@lo:400:kworker.0 00000100:00080000:3.0:1790391230.362911:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391230.362916:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391230.362918:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391230.364399:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391230.364416:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130770432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391230.364478:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391230.364525:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770432 00000100:00100000:2.0:1790391230.364531:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770432 00000100:00100000:2.0:1790391230.364570:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391230.364579:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130770432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391230.364611:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391230.364653:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130770432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.364660:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790391230.364699:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f1b480 x1877361130770432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391230.364716:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130770432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391230.744285:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391230.744333:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391230.744377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391230.744404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720640 00000100:00100000:2.0:1790391230.744414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720640 00000100:00100000:2.0:1790391230.744496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:2.0:1790391230.744506:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108720640:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391230.744591:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108720640:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.744601:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00080000:2.0:1790391230.744622:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391230.744653:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391230.744980:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720768 00000100:00100000:2.0:1790391230.744984:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720768 00000100:00100000:2.0:1790391230.745106:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720896 00000100:00100000:2.0:1790391230.745110:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720896 00000100:00100000:2.0:1790391230.745130:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:2.0:1790391230.745136:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2363:x1877361108720768:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391230.745171:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2363:x1877361108720768:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 34us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.745178:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:2.0:1790391230.745189:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:2.0:1790391230.745195:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2363:x1877361108720896:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391230.745216:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2363:x1877361108720896:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 21us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391230.745221:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00080000:2.0:1790391230.745505:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391230.745509:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391230.745583:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108720512 00000100:00100000:0.0:1790391230.745588:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108720512 00000100:00100000:0.0:1790391230.745626:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 193 00000100:00100000:0.0:1790391230.745743:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2363:x1877361108720512:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391230.745778:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2363:x1877361108720512:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 40us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391230.745795:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 193 00010000:00010000:2.0:1790391230.810484:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391231.838971:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391232.416590:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391232.416614:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130770560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391232.416680:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391232.416744:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770560 00000100:00100000:1.0:1790391232.416752:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770560 00000100:00100000:1.0:1790391232.417112:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391232.417123:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130770560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391232.417159:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391232.417203:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130770560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391232.417211:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790391232.417231:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391232.417263:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439942a00 x1877361130770560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391232.417282:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130770560:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1790391232.483284:0:8818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1790391232.865634:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391233.881769:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391234.905308:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391235.481214:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391235.481236:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130770688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391235.481311:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391235.481389:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770688 00000100:00100000:2.0:1790391235.481397:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770688 00000100:00100000:2.0:1790391235.481453:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391235.481462:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130770688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391235.481499:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391235.481553:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130770688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391235.481560:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790391235.481580:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790391235.481614:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439b4a680 x1877361130770688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391235.481631:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130770688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391235.493917:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130770816:0@lo:400:kworker.0 00000100:00100000:2.0:1790391235.494009:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391235.494263:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770816 00000100:00100000:3.0:1790391235.494271:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770816 00000100:00100000:3.0:1790391235.494332:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1790391235.494342:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130770816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.500257:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130770944:0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.500399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391235.500439:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391235.500445:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130771328:0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.500473:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391235.500542:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130770944 00000100:00100000:1.0:1790391235.500551:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130770944 00000100:00100000:1.0:1790391235.500595:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771328 00000100:00100000:1.0:1790391235.500598:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771328 00000100:00100000:1.0:1790391235.500628:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391235.500637:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130770944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.500702:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130770944:12345-0@lo:400:kworker.0 Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391235.500709:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391235.500725:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391235.500731:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130771328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.500760:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130771328:12345-0@lo:400:kworker.0 Request processed in 29us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391235.500766:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391235.500788:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130771072:0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.500829:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391235.500850:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391235.500855:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130771200:0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.500877:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391235.500898:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771200 00000100:00100000:1.0:1790391235.500911:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771200 00000100:00100000:1.0:1790391235.500937:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391235.500943:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130771200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.502964:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130771200:12345-0@lo:400:kworker.0 Request processed in 2010us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391235.502980:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391235.503070:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130771328:0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.503213:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130770944:0@lo:400:kworker.0 00000100:00100000:1.0:1790391235.503250:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130771200:0@lo:400:kworker.0 00000100:00080000:1.0:1790391235.503376:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391235.503616:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130770816:12345-0@lo:400:kworker.0 Request processed in 9274us (9606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391235.503626:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1790391235.503773:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130770816:0@lo:400:kworker.0 00000100:00100000:3.0:1790391235.503911:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771072 00000100:00100000:3.0:1790391235.503919:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771072 00000100:00100000:3.0:1790391235.504092:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391235.504100:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790391235.504106:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130771072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391235.504113:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790391235.504179:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130771072:12345-0@lo:400:kworker.0 Request processed in 79us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391235.504186:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790391235.504223:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439942300 x1877361130771072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391235.504250:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130771072:0@lo:400:kworker.0 00000100:00080000:1.0:1790391235.504441:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391235.852705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391235.852748:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391235.852876:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721024 00000100:00100000:2.0:1790391235.852886:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721024 00000100:00100000:2.0:1790391235.852943:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 195 00000100:00100000:2.0:1790391235.852954:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108721024:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391235.853046:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108721024:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 93us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391235.853060:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 195 00000100:00100000:1.0:1790391235.853278:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721152 00000100:00100000:1.0:1790391235.853283:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721152 00000100:00100000:1.0:1790391235.853344:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:1.0:1790391235.853362:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108721152:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391235.853401:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108721152:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 50us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391235.853408:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00080000:2.0:1790391235.854227:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391235.873762:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391235.873807:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391235.873903:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721280 00000100:00100000:2.0:1790391235.873913:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721280 00000100:00100000:2.0:1790391235.873991:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721408 00000100:00100000:2.0:1790391235.873995:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721408 00000100:00100000:2.0:1790391235.874040:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:2.0:1790391235.874049:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2362:x1877361108721280:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:2.0:1790391235.874089:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a6d4 00000100:00080000:2.0:1790391235.874098:0:6695:0:(import.c:65:import_set_state_nolock()) ffff96243fa30000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391235.874137:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790391235.874530:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+2:2362:x1877361108721280:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 480us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391235.874538:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:2.0:1790391235.874556:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:2.0:1790391235.874563:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2362:x1877361108721408:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:2.0:1790391235.874578:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a6db 00000100:00080000:2.0:1790391235.874584:0:6695:0:(import.c:65:import_set_state_nolock()) ffff96243fa35800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391235.874607:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790391235.874819:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+2:2362:x1877361108721408:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 255us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391235.874826:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00010000:00010000:2.0:1790391235.874902:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391235.874909:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391235.875362:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391235.875367:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391235.938317:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391236.961471:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391237.529632:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391237.529654:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130771456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391237.529719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391237.529809:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771456 00000100:00100000:1.0:1790391237.529816:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771456 00000100:00100000:1.0:1790391237.529880:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790391237.529889:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130771456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391237.529922:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391237.529968:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130771456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391237.529987:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1790391237.530116:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391237.530220:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439940000 x1877361130771456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391237.530240:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130771456:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790391237.935836:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing yml_node 00010000:00010000:0.0:1790391237.981237:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391239.001246:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391240.025244:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790391240.162957:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:0.0:1790391240.162968:0:7657:0:(genops.c:885:class_export_put()) final put ffff96243fa36800/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:3.0:1790391240.163040:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96243fa36800/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f for lustre-OST0001 00000020:00000080:3.0:1790391240.163095:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243fa35800 for lustre-OST0001 00000001:00100000:1.0:1790391240.176969:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:1.0:1790391240.176977:0:6726:0:(genops.c:885:class_export_put()) final put ffff96243fa34000/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:0.0:1790391240.177312:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96243fa34000/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f for lustre-OST0000 00000020:00000080:0.0:1790391240.177375:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243fa30000 for lustre-OST0000 00000100:00100000:2.0:1790391240.601252:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130771840:0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.601268:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130771584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391240.604501:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130771968:0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.604896:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391240.604957:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130771712:0@lo:400:kworker.0 00000100:00100000:0.0:1790391240.604974:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130772096:0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.604996:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391240.605043:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130772224:0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.605069:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391240.605087:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391240.605092:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130772352:0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.605113:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391240.605151:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771712 00000100:00100000:3.0:1790391240.605158:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771712 00000100:00100000:3.0:1790391240.605215:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790391240.605224:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130771712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.605285:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130771712:12345-0@lo:400:kworker.0 Request processed in 50us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391240.605306:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790391240.605354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391240.605372:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130771712:0@lo:400:kworker.0 00000100:00100000:0.0:1790391240.605412:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772224 00000100:00100000:3.0:1790391240.605417:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772352 00000100:00100000:0.0:1790391240.605417:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772224 00000100:00100000:3.0:1790391240.605424:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772352 00000100:00100000:3.0:1790391240.605471:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391240.605472:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772096 00000100:00100000:0.0:1790391240.605477:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772096 00000100:00100000:3.0:1790391240.605481:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130772352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391240.605505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391240.605515:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130772224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.605528:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130772352:12345-0@lo:400:kworker.0 Request processed in 50us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391240.605551:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391240.605556:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130772224:12345-0@lo:400:kworker.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391240.605565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391240.605583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1790391240.605590:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439943100 x1877361130772352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391240.605601:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130772096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.605607:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130772352:0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.605637:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130772224:0@lo:400:kworker.0 00000100:00100000:0.0:1790391240.605660:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130772096:12345-0@lo:400:kworker.0 Request processed in 62us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391240.605668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1790391240.605677:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391240.605683:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391240.605702:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771584 00000100:00100000:0.0:1790391240.605703:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130772096:0@lo:400:kworker.0 00000100:00100000:3.0:1790391240.605707:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771584 00000100:00100000:3.0:1790391240.605739:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790391240.605745:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130771584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391240.605771:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391240.605805:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130771584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391240.605811:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790391240.605840:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439b4a680 x1877361130771584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391240.605868:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130771584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391240.610406:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391240.610492:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771840 00000100:00100000:0.0:1790391240.610503:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771840 00000100:00100000:0.0:1790391240.610558:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391240.610567:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130771840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391240.610730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391240.610785:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130771968 00000100:00100000:1.0:1790391240.610790:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130771968 00000100:00100000:1.0:1790391240.610828:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391240.610835:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130771968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391240.610873:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130771968:12345-0@lo:400:kworker.0 Request processed in 38us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391240.610880:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790391240.610900:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391240.610928:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439940e00 x1877361130771968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391240.610942:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130771968:0@lo:400:kworker.0 00000100:00100000:0.0:1790391240.620046:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130771840:12345-0@lo:400:kworker.0 Request processed in 9467us (9634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391240.620067:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391240.620205:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130771840:0@lo:400:kworker.0 00000100:00100000:0.0:1790391240.986987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391240.987078:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391240.987237:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721664 00000100:00100000:2.0:1790391240.987247:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721664 00000100:00100000:2.0:1790391240.987343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:2.0:1790391240.987354:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108721664:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391240.987429:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108721664:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391240.987436:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00080000:3.0:1790391240.987613:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391240.987972:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721536 00000100:00100000:1.0:1790391240.987979:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721536 00000100:00100000:1.0:1790391240.988046:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 197 00000100:00100000:1.0:1790391240.988055:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2363:x1877361108721536:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391240.988098:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2363:x1877361108721536:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 44us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391240.988104:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 197 00010000:00010000:2.0:1790391241.050695:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391242.089901:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391242.654384:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130772480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391242.654456:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391242.654654:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772480 00000100:00100000:0.0:1790391242.654663:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772480 00000100:00100000:0.0:1790391242.654720:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391242.654729:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130772480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391242.654769:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391242.654990:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130772480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 261us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391242.654999:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1790391242.655035:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391242.655072:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f19500 x1877361130772480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391242.655108:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130772480:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790391242.677138:0:9256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00010000:00010000:2.0:1790391243.101168:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391244.123581:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391245.157950:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790391245.672746:0:9354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00000100:00100000:2.0:1790391245.740702:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130772608:0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.740780:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391245.740837:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130773120:0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.740866:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391245.740893:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391245.740899:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130772992:0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.740920:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391245.740950:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130773120 00000100:00100000:2.0:1790391245.740964:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130772864:0@lo:400:kworker.0 00000100:00100000:1.0:1790391245.740966:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130773120 00000100:00100000:2.0:1790391245.740989:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391245.741007:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790391245.741029:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130772736:0@lo:400:kworker.0 00000100:00100000:1.0:1790391245.741049:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772992 00000100:00100000:2.0:1790391245.741050:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391245.741053:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772992 00000100:00100000:1.0:1790391245.741066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772736 00000100:00100000:1.0:1790391245.741068:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772736 00000100:00100000:2.0:1790391245.741074:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130773248:0@lo:400:kworker.0 00000100:00100000:1.0:1790391245.741081:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790391245.741089:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130773120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.741094:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391245.741119:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391245.741126:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130772992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391245.741139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130773120:12345-0@lo:400:kworker.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391245.741145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790391245.741161:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391245.741167:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130772736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.741168:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130772992:12345-0@lo:400:kworker.0 Request processed in 43us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391245.741174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391245.741208:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130772736:12345-0@lo:400:kworker.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391245.741213:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1790391245.741226:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391245.741231:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130772736:0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.741261:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130772992:0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.741269:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130773120:0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.745064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772608 00000100:00100000:2.0:1790391245.745080:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772608 00000100:00100000:2.0:1790391245.745135:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790391245.745154:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130772608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391245.745258:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130772608:12345-0@lo:400:kworker.0 Request processed in 105us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391245.745265:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790391245.745457:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130772608:0@lo:400:kworker.0 00000100:00100000:0.0:1790391245.747454:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130772864 00000100:00100000:0.0:1790391245.747470:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130772864 00000100:00100000:0.0:1790391245.747550:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130773248 00000100:00100000:0.0:1790391245.747554:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130773248 00000100:00100000:0.0:1790391245.747582:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391245.747592:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130772864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391245.747679:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130772864:12345-0@lo:400:kworker.0 Request processed in 89us (6688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391245.747686:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391245.747701:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391245.747706:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130773248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391245.747732:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130773248:12345-0@lo:400:kworker.0 Request processed in 27us (6636us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391245.747737:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1790391245.747781:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f721f80 x1877361130773248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391245.747807:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130773248:0@lo:400:kworker.0 00010000:00080000:0.0:1790391245.747820:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f720e00 x1877361130772864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391245.747828:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130772864:0@lo:400:kworker.0 00000100:00080000:1.0:1790391245.748081:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391245.748085:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391245.749290:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391245.749312:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130773376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391245.749363:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391245.749404:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130773376 00000100:00100000:0.0:1790391245.749411:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130773376 00000100:00100000:0.0:1790391245.749449:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391245.749457:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130773376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391245.749487:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391245.749545:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130773376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391245.749552:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1790391245.749591:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f19500 x1877361130773376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391245.749609:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130773376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391246.108575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391246.108711:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391246.108777:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721920 00000100:00100000:2.0:1790391246.108796:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721920 00000100:00100000:2.0:1790391246.108862:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:2.0:1790391246.108871:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108721920:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391246.108956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108721920:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391246.108963:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00080000:0.0:1790391246.109735:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391246.111298:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108721792 00000100:00100000:3.0:1790391246.111311:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108721792 00000100:00100000:3.0:1790391246.111400:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 199 00000100:00100000:3.0:1790391246.111409:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108721792:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391246.111495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108721792:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 79us (3715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391246.111503:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 199 00010000:00010000:0.0:1790391246.169252:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391247.193941:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391247.772393:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391247.772419:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130773504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391247.772554:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.783611:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130773504 00000100:00100000:0.0:1790391247.783862:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130773504 00000100:00100000:0.0:1790391247.783954:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391247.783968:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130773504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391247.784010:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391247.784109:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130773504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (11554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.784117:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790391247.784199:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439940e00 x1877361130773504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391247.784366:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391247.784536:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130773504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790391248.217642:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790391248.542715:0:9452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00010000:00010000:2.0:1790391249.244174:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790391250.188172:0:9500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 25 22:54:08 EDT 2026 00010000:00010000:0.0:1790391250.267805:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391250.841431:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391250.841454:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130773632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391250.841520:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391250.841595:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130773632 00000100:00100000:0.0:1790391250.841601:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130773632 00000100:00100000:0.0:1790391250.841652:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391250.841661:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130773632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391250.841693:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391250.841736:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130773632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391250.841743:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1790391250.841778:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f19f80 x1877361130773632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391250.841795:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130773632:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790391250.842102:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391250.842150:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130774016:0@lo:400:kworker.0 00000100:00100000:3.0:1790391250.842176:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130774144:0@lo:400:kworker.0 00000100:00100000:1.0:1790391250.842190:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391250.842256:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391250.842368:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130773888:0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842407:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391250.842440:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790391250.842447:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130773760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842473:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391250.842495:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130774272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842516:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391250.842541:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130773760 00000100:00100000:2.0:1790391250.842545:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130773760 00000100:00100000:2.0:1790391250.842587:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790391250.842594:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130773760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842631:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130773760:12345-0@lo:400:kworker.0 Request processed in 37us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391250.842637:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790391250.842664:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774144 00000100:00100000:2.0:1790391250.842668:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774144 00000100:00100000:2.0:1790391250.842695:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130773888 00000100:00100000:2.0:1790391250.842697:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130773888 00000100:00100000:2.0:1790391250.842707:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774272 00000100:00100000:2.0:1790391250.842709:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774272 00000100:00100000:2.0:1790391250.842720:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391250.842726:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130774144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842760:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130774144:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391250.842765:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391250.842792:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391250.842797:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130773888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842822:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130773888:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391250.842828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391250.842838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391250.842843:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130774272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842867:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130774272:12345-0@lo:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391250.842873:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391250.842909:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130773760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842921:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130774272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391250.842930:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130773888:0@lo:400:kworker.0 00000100:00080000:1.0:1790391250.843187:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391250.848955:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774016 00000100:00100000:0.0:1790391250.848978:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774016 00000100:00080000:1.0:1790391250.849154:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391250.849166:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391250.849181:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130774016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391250.849319:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130774016:12345-0@lo:400:kworker.0 Request processed in 141us (7131us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391250.849328:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1790391250.849405:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d862a00 x1877361130774016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391250.849447:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130774016:0@lo:400:kworker.0 00000100:00100000:3.0:1790391250.849486:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130774144:0@lo:400:kworker.0 00000100:00100000:3.0:1790391251.210606:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391251.210650:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391251.210729:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722176 00000100:00100000:2.0:1790391251.210739:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722176 00000100:00100000:2.0:1790391251.210816:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:2.0:1790391251.210827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108722176:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391251.210906:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108722176:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391251.210914:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00080000:3.0:1790391251.211259:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391251.211576:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722048 00000100:00100000:1.0:1790391251.211584:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722048 00000100:00100000:1.0:1790391251.211625:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 201 00000100:00100000:1.0:1790391251.211632:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108722048:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391251.211679:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108722048:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 47us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391251.211686:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 201 00010000:00010000:1.0:1790391251.297178:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391252.316797:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391252.890313:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391252.890335:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130774400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391252.890400:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391252.890458:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774400 00000100:00100000:1.0:1790391252.890465:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774400 00000100:00100000:1.0:1790391252.890522:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391252.890530:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130774400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391252.890563:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391252.890605:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130774400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391252.890611:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1790391252.890629:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391252.890659:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439943100 x1877361130774400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391252.890688:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130774400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790391253.339359:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391254.361844:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391255.386348:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391255.962644:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391255.962670:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130774528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391255.962749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391255.962941:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774528 00000100:00100000:1.0:1790391255.962955:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774528 00000100:00100000:1.0:1790391255.963060:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391255.963071:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130774528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391255.963109:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391255.963161:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130774528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391255.963169:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790391255.963228:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f720a80 x1877361130774528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391255.963248:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130774528:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790391255.963396:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391255.966575:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130774656:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.966648:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391255.966714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774656 00000100:00100000:1.0:1790391255.966724:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774656 00000100:00100000:1.0:1790391255.966774:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790391255.966785:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130774656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.966834:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130774656:12345-0@lo:400:kworker.0 Request processed in 50us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391255.966841:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790391255.966892:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130774656:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.966936:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130774784:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.966963:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391255.966995:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774784 00000100:00100000:1.0:1790391255.966998:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774784 00000100:00100000:1.0:1790391255.967064:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790391255.967079:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130774784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967115:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130774784:12345-0@lo:400:kworker.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391255.967121:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790391255.967147:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130774784:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967178:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130774912:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967203:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391255.967236:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130774912 00000100:00100000:1.0:1790391255.967240:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130774912 00000100:00100000:1.0:1790391255.967274:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391255.967281:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130774912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967315:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130774912:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391255.967321:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790391255.967336:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391255.967368:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439943100 x1877361130774912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391255.967380:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130774912:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967413:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130775040:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967436:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391255.967463:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775040 00000100:00100000:1.0:1790391255.967467:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775040 00000100:00100000:1.0:1790391255.967494:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790391255.967501:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130775040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967535:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130775040:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391255.967547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1790391255.967565:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391255.967581:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130775040:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967614:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130775168:0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391255.967661:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775168 00000100:00100000:1.0:1790391255.967665:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775168 00000100:00100000:1.0:1790391255.967688:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790391255.967694:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130775168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391255.967725:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130775168:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391255.967732:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1790391255.967744:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391255.967761:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130775168:0@lo:400:kworker.0 00000100:00100000:0.0:1790391256.334141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391256.334193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391256.334225:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722304 00000100:00100000:0.0:1790391256.334234:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722304 00000100:00100000:0.0:1790391256.334281:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 203 00000100:00100000:0.0:1790391256.334292:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2365:x1877361108722304:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391256.334361:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2365:x1877361108722304:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.334369:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 203 00000100:00100000:3.0:1790391256.334569:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722432 00000100:00100000:3.0:1790391256.334573:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722432 00000100:00100000:3.0:1790391256.334771:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:3.0:1790391256.334782:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108722432:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391256.334828:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108722432:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 49us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391256.334844:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00080000:0.0:1790391256.335718:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790391256.420797:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391257.438351:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391258.009478:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130775296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391258.009554:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391258.009899:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775296 00000100:00100000:0.0:1790391258.009909:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775296 00000100:00100000:0.0:1790391258.009979:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391258.009999:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130775296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391258.010068:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790391258.010143:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391258.011678:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130775296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1683us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391258.011691:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1790391258.011841:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439943100 x1877361130775296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391258.011868:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130775296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391258.457230:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391259.487708:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391260.508267:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391261.083153:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391261.083177:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130775424:0@lo:400:kworker.0 00000100:00100000:1.0:1790391261.083244:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130775552:0@lo:400:kworker.0 00000100:00100000:0.0:1790391261.083247:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391261.083279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391261.083293:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130775808:0@lo:400:kworker.0 00000100:00100000:1.0:1790391261.083297:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130776064:0@lo:400:kworker.0 00000100:00100000:1.0:1790391261.083316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391261.083327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391261.083334:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391261.083339:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130775680:0@lo:400:kworker.0 00000100:00100000:0.0:1790391261.083339:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391261.083344:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130775936:0@lo:400:kworker.0 00000100:00100000:1.0:1790391261.083360:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391261.083360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391261.083430:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776064 00000100:00100000:0.0:1790391261.083438:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776064 00000100:00100000:1.0:1790391261.083465:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775680 00000100:00100000:1.0:1790391261.083469:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775680 00000100:00100000:0.0:1790391261.083492:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391261.083501:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130776064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391261.083505:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391261.083510:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130775680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391261.083545:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130775680:12345-0@lo:400:kworker.0 Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391261.083552:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391261.083556:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130776064:12345-0@lo:400:kworker.0 Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391261.083570:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1790391261.083572:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391261.083576:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391261.083584:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130776192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391261.083585:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775552 00000100:00100000:0.0:1790391261.083589:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775552 00000100:00100000:0.0:1790391261.083609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775808 00000100:00100000:1.0:1790391261.083610:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391261.083611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775808 00000100:00100000:0.0:1790391261.083629:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775936 00000100:00100000:0.0:1790391261.083631:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775936 00000100:00100000:1.0:1790391261.083636:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776192 00000100:00100000:1.0:1790391261.083639:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776192 00000100:00100000:0.0:1790391261.083644:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391261.083649:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130775552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391261.083660:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391261.083666:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130776192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391261.083694:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391261.083728:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130776192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391261.083755:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790391261.083768:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130775808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391261.083808:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130775808:12345-0@lo:400:kworker.0 Request processed in 44us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391261.083814:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790391261.083828:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790391261.083834:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130775936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391261.083858:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130775936:12345-0@lo:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391261.083864:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790391261.083908:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130775936:0@lo:400:kworker.0 00000100:00100000:3.0:1790391261.083930:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130775808:0@lo:400:kworker.0 00000100:00100000:0.0:1790391261.084101:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130775552:12345-0@lo:400:kworker.0 Request processed in 451us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391261.084108:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391261.084122:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391261.084127:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130775424 00000100:00100000:0.0:1790391261.084131:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130775424 00010000:00080000:1.0:1790391261.084148:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f3aa00 x1877361130776192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391261.084158:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790391261.084163:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130776192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391261.084164:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130775424:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790391261.084185:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa76a00 x1877361130775680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391261.084194:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130775680:0@lo:400:kworker.0 00000100:00100000:0.0:1790391261.084196:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130775424:12345-0@lo:400:kworker.0 Request processed in 33us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391261.084202:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790391261.084203:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130775552:0@lo:400:kworker.0 00010000:00080000:1.0:1790391261.084222:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa75880 x1877361130776064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790391261.084231:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391261.084314:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130776064:0@lo:400:kworker.0 00000100:00100000:3.0:1790391261.084573:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130775424:0@lo:400:kworker.0 00000100:00100000:3.0:1790391261.452706:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391261.452749:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391261.452912:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722560 00000100:00100000:1.0:1790391261.452921:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722560 00000100:00100000:1.0:1790391261.452992:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 205 00000100:00100000:1.0:1790391261.453002:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108722560:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391261.453083:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108722560:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 83us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391261.453091:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 205 00000100:00100000:2.0:1790391261.453573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722688 00000100:00100000:2.0:1790391261.453579:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722688 00000100:00100000:2.0:1790391261.453634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:2.0:1790391261.453642:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108722688:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391261.453682:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108722688:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 40us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391261.453689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00080000:1.0:1790391261.453808:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790391261.529204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391262.558605:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391263.129130:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391263.129346:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130776320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391263.129431:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391263.130698:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776320 00000100:00100000:3.0:1790391263.130710:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776320 00000100:00100000:3.0:1790391263.130806:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391263.130818:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130776320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391263.130913:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391263.131050:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130776320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 235us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391263.131070:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790391263.131112:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f721880 x1877361130776320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391263.131134:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130776320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391263.131567:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391263.580928:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391264.605689:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391265.626397:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790391266.048285:0:10130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:54:24 (1790391264) === 00000100:00100000:3.0:1790391266.203317:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130776448:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.203404:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391266.203449:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130776960:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.203490:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391266.203519:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391266.203525:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130776832:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.203546:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391266.203576:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130776576:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.203599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391266.203618:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130777088:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.203641:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391266.203660:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391266.203665:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130776704:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.203686:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391266.203717:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776448 00000100:00100000:3.0:1790391266.203725:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776448 00000100:00100000:3.0:1790391266.203773:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790391266.203783:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130776448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.203833:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130776448:12345-0@lo:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.203865:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790391266.203900:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776960 00000100:00100000:3.0:1790391266.203904:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776960 00000100:00100000:3.0:1790391266.203940:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776832 00000100:00100000:3.0:1790391266.203943:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776832 00000100:00100000:3.0:1790391266.203956:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776576 00000100:00100000:3.0:1790391266.203958:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776576 00000100:00100000:3.0:1790391266.203971:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790391266.203977:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130776960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204011:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130776960:12345-0@lo:400:kworker.0 Request processed in 34us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.204045:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790391266.204058:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790391266.204064:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130776832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204089:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130776832:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.204094:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790391266.204104:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790391266.204109:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130776576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204137:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130776576:12345-0@lo:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.204142:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790391266.204164:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777088 00000100:00100000:3.0:1790391266.204168:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777088 00000100:00100000:3.0:1790391266.204192:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130776704 00000100:00100000:3.0:1790391266.204194:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130776704 00000100:00100000:3.0:1790391266.204213:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391266.204227:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130777088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204259:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130777088:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.204265:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391266.204276:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790391266.204282:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130776704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204309:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130776704:12345-0@lo:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.204314:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1790391266.204334:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391266.204338:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391266.204340:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391266.204373:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03d500 x1877361130776704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391266.204387:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130776704:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204399:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130776576:0@lo:400:kworker.0 00010000:00080000:3.0:1790391266.204407:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03e680 x1877361130777088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391266.204415:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130777088:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204442:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130776832:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204450:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130776448:0@lo:400:kworker.0 00000100:00100000:3.0:1790391266.204457:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130776960:0@lo:400:kworker.0 00000100:00100000:2.0:1790391266.209736:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391266.209758:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130777216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391266.209823:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391266.209880:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777216 00000100:00100000:2.0:1790391266.209888:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777216 00000100:00100000:2.0:1790391266.209940:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790391266.209949:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130777216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391266.209983:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391266.210053:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130777216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391266.210068:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790391266.210129:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f723100 x1877361130777216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391266.210148:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130777216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391266.405118:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.405358:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722816 00000100:00100000:0.0:1790391266.405369:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722816 00000100:00100000:0.0:1790391266.405430:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 207 00000100:00100000:0.0:1790391266.405442:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+10:8151:x1877361108722816:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391266.405469:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391266.405490:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400030600/0x35e94fc15449a79f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc0c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391266.405520:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030600/0x35e94fc15449a79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc0c expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391266.405531:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400030600/0x35e94fc15449a79f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc0c expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391266.405540:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030600, rc 0) 00000100:00100000:0.0:1790391266.405602:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8151:x1877361108722816:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 162us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.405609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 207 00000100:00100000:2.0:1790391266.408108:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.408198:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108722944 00000100:00100000:3.0:1790391266.408209:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108722944 00000100:00100000:3.0:1790391266.408273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 208 00000100:00100000:3.0:1790391266.408284:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8151:x1877361108722944:12345-192.168.201.8@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790391266.408861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8151:x1877361108722944:12345-192.168.201.8@tcp:501:mount.lustre.0 Request processed in 566us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.408869:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 208 00000100:00100000:1.0:1790391266.411139:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.411355:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723072 00000100:00100000:3.0:1790391266.411365:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723072 00000100:00100000:3.0:1790391266.411421:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 209 00000100:00100000:3.0:1790391266.411431:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8151:x1877361108723072:12345-192.168.201.8@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790391266.411645:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8151:x1877361108723072:12345-192.168.201.8@tcp:503:mount.lustre.0 Request processed in 216us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.411653:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 209 00000100:00100000:1.0:1790391266.428837:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.428923:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723200 00000100:00100000:0.0:1790391266.428934:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723200 00000100:00100000:0.0:1790391266.428993:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 210 00000100:00100000:0.0:1790391266.429004:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8153:x1877361108723200:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391266.429623:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8153:x1877361108723200:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 616us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.429645:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 210 00000100:00100000:2.0:1790391266.444094:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391266.444202:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723328 00000100:00100000:1.0:1790391266.444683:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723328 00000100:00100000:1.0:1790391266.444751:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 211 00000100:00100000:1.0:1790391266.444763:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8153:x1877361108723328:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391266.445195:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8153:x1877361108723328:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 434us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391266.445204:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 211 00000100:00100000:1.0:1790391266.455559:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.455735:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723456 00000100:00100000:3.0:1790391266.455745:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723456 00000100:00100000:3.0:1790391266.455801:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 212 00000100:00100000:3.0:1790391266.455812:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+11:8151:x1877361108723456:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790391266.455830:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391266.455860:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449a7a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc36 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391266.455888:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449a7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc36 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391266.455899:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449a7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc36 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391266.455928:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3a00, rc 0) 00000100:00100000:3.0:1790391266.455993:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+12:8151:x1877361108723456:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 183us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.456001:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 212 00000100:00100000:3.0:1790391266.463657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.463760:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723584 00000100:00100000:0.0:1790391266.463770:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723584 00000100:00100000:0.0:1790391266.463827:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 213 00000100:00100000:0.0:1790391266.463839:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:8151:x1877361108723584:12345-192.168.201.8@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790391266.463881:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790391266.463904:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790391266.463908:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790391266.463911:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790391266.463913:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1790391266.465819:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:8151:x1877361108723584:12345-192.168.201.8@tcp:256:mount.lustre.0 Request processed in 1972us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.465833:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 213 00000100:00100000:1.0:1790391266.471952:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.472045:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723712 00000100:00100000:3.0:1790391266.472056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723712 00000100:00100000:3.0:1790391266.472117:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 214 00000100:00100000:3.0:1790391266.472124:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:8151:x1877361108723712:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790391266.472140:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391266.472155:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc3d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391266.472189:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391266.472198:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391266.472205:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2200, rc 0) 00000100:00100000:3.0:1790391266.472762:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8151:x1877361108723712:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 636us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.472768:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 214 00000100:00100000:3.0:1790391266.475993:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.476583:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723840 00000100:00100000:0.0:1790391266.476594:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723840 00000100:00100000:0.0:1790391266.476692:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 215 00000100:00100000:0.0:1790391266.476702:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8151:x1877361108723840:12345-192.168.201.8@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790391266.477042:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8151:x1877361108723840:12345-192.168.201.8@tcp:501:mount.lustre.0 Request processed in 314us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.477050:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 215 00000100:00100000:2.0:1790391266.479249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.479779:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108723968 00000100:00100000:0.0:1790391266.479787:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108723968 00000100:00100000:0.0:1790391266.479827:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 216 00000100:00100000:0.0:1790391266.479833:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8151:x1877361108723968:12345-192.168.201.8@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790391266.480082:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8151:x1877361108723968:12345-192.168.201.8@tcp:503:mount.lustre.0 Request processed in 247us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.480098:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 216 00000100:00100000:1.0:1790391266.482929:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.483219:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724096 00000100:00100000:0.0:1790391266.483231:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724096 00000100:00100000:0.0:1790391266.483425:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 217 00000100:00100000:0.0:1790391266.483434:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8159:x1877361108724096:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391266.483639:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8159:x1877361108724096:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 206us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.483646:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 217 00000100:00100000:1.0:1790391266.486809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.486910:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724224 00000100:00100000:3.0:1790391266.486920:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724224 00000100:00100000:3.0:1790391266.486983:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 218 00000100:00100000:3.0:1790391266.486992:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8159:x1877361108724224:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391266.487518:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:8159:x1877361108724224:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 463us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.487528:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 218 00000100:00100000:2.0:1790391266.495876:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.496113:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724352 00000100:00100000:3.0:1790391266.496124:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724352 00000100:00100000:3.0:1790391266.496239:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:3.0:1790391266.496249:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1877361108724352:12345-192.168.201.8@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790391266.496397:0:8292:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d0b40030-8079-4d0d-add3-36e0ceb183ab@192.168.201.8@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1790391266.496436:0:8292:0:(genops.c:1385:class_connect()) connect: client d0b40030-8079-4d0d-add3-36e0ceb183ab, cookie 0x35e94fc15449a7b4 00000004:00100000:3.0:1790391266.496473:0:8292:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790391266.496736:0:8292:0:(import.c:65:import_set_state_nolock()) ffff962439923800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391266.496816:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2362:x1877361108724352:12345-192.168.201.8@tcp:38:mount.lustre.0 Request processed in 564us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.496825:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391266.498062:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.498157:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724736 00000100:00100000:3.0:1790391266.498165:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724736 00000100:00100000:3.0:1790391266.498429:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:3.0:1790391266.498440:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108724736:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391266.498855:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108724736:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 406us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.498864:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00080000:1.0:1790391266.499802:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391266.503375:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.503520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724480 00000100:00100000:0.0:1790391266.503530:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724480 00000100:00100000:0.0:1790391266.503601:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1790391266.503611:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:0:x1877361108724480:12345-192.168.201.8@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391266.503664:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790391266.503817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:0:x1877361108724480:12345-192.168.201.8@tcp:41:mount.lustre.0 Request processed in 207us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.503825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00080000:1.0:1790391266.503985:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391266.505517:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391266.505610:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724608 00000100:00100000:3.0:1790391266.505618:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724608 00000100:00100000:3.0:1790391266.505669:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:3.0:1790391266.505689:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:8151:x1877361108724608:12345-192.168.201.8@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790391266.505716:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790391266.505772:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:8151:x1877361108724608:12345-192.168.201.8@tcp:41:mount.lustre.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391266.505779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:2.0:1790391266.508403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.508505:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724864 00000100:00100000:0.0:1790391266.508515:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724864 00000100:00100000:0.0:1790391266.508576:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1790391266.508585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:8151:x1877361108724864:12345-192.168.201.8@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790391266.508673:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:8151:x1877361108724864:12345-192.168.201.8@tcp:40:mount.lustre.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.508680:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:1.0:1790391266.510987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391266.511102:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108725248 00000100:00100000:2.0:1790391266.511112:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108725248 00000100:00100000:2.0:1790391266.511169:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:2.0:1790391266.511191:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:8151:x1877361108725248:12345-192.168.201.8@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790391266.511729:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790391266.511830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:8151:x1877361108725248:12345-192.168.201.8@tcp:33:mount.lustre.0 Request processed in 650us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391266.511838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:2.0:1790391266.513071:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391266.513107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391266.513508:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108724992 00000100:00100000:0.0:1790391266.513530:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108724992 00000100:00100000:0.0:1790391266.513574:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108725120 00000100:00100000:0.0:1790391266.513578:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108725120 00000100:00100000:0.0:1790391266.513604:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1790391266.513612:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2362:x1877361108724992:12345-192.168.201.8@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790391266.513642:0:8917:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d0b40030-8079-4d0d-add3-36e0ceb183ab@192.168.201.8@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:0.0:1790391266.513681:0:8917:0:(genops.c:1385:class_connect()) connect: client d0b40030-8079-4d0d-add3-36e0ceb183ab, cookie 0x35e94fc15449a7bb 00002000:00100000:0.0:1790391266.513694:0:8917:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d0b40030-8079-4d0d-add3-36e0ceb183ab/ffff962427e81800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391266.513715:0:8917:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391266.513974:0:8917:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391266.514006:0:8917:0:(import.c:65:import_set_state_nolock()) ffff962427e87800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391266.514097:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2362:x1877361108724992:12345-192.168.201.8@tcp:8:mount.lustre.0 Request processed in 484us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.514105:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1790391266.514122:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:0.0:1790391266.514126:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2362:x1877361108725120:12345-192.168.201.8@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790391266.514139:0:8917:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d0b40030-8079-4d0d-add3-36e0ceb183ab@192.168.201.8@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:0.0:1790391266.514155:0:8917:0:(genops.c:1385:class_connect()) connect: client d0b40030-8079-4d0d-add3-36e0ceb183ab, cookie 0x35e94fc15449a7c2 00002000:00100000:0.0:1790391266.514161:0:8917:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0b40030-8079-4d0d-add3-36e0ceb183ab/ffff962427e86000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391266.514167:0:8917:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391266.518037:0:8917:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790391266.518082:0:8917:0:(import.c:65:import_set_state_nolock()) ffff962427e82000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391266.518153:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2362:x1877361108725120:12345-192.168.201.8@tcp:8:mount.lustre.0 Request processed in 4022us (5042us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391266.518164:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00010000:00010000:2.0:1790391266.649769:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391267.673921:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391268.252381:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130777344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391268.252453:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391268.252589:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777344 00000100:00100000:3.0:1790391268.252598:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777344 00000100:00100000:3.0:1790391268.253986:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391268.254004:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130777344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391268.254058:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391268.254130:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130777344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391268.254138:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1790391268.254274:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d00f480 x1877361130777344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391268.254297:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130777344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391268.255856:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391268.698998:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391269.724739:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391270.748669:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790391270.901340:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0b40030-8079-4d0d-add3-36e0ceb183ab 00000001:00100000:1.0:1790391270.904627:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0b40030-8079-4d0d-add3-36e0ceb183ab 00000001:00100000:1.0:1790391270.925765:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0b40030-8079-4d0d-add3-36e0ceb183ab 00000100:00100000:2.0:1790391271.321547:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130777856:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.321821:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130777472:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.321898:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391271.321949:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130777984:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.321977:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391271.322034:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777984 00000100:00100000:3.0:1790391271.322042:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777984 00000100:00100000:3.0:1790391271.322098:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790391271.322122:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322174:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130777984:12345-0@lo:400:kworker.0 Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.322182:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1790391271.322203:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391271.322230:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130777984:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322266:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130777600:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322292:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391271.322310:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130778112:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322332:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391271.322348:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391271.322353:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130777728:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322386:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391271.322413:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130778112 00000100:00100000:3.0:1790391271.322416:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130778112 00000100:00100000:3.0:1790391271.322443:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777728 00000100:00100000:3.0:1790391271.322445:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777728 00000100:00100000:3.0:1790391271.322462:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391271.322468:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130778112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322500:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130778112:12345-0@lo:400:kworker.0 Request processed in 32us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.322506:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391271.322516:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391271.322522:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130777728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322547:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130777728:12345-0@lo:400:kworker.0 Request processed in 26us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.322822:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1790391271.322843:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391271.322847:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790391271.322868:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f721f80 x1877361130777728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391271.322879:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130777728:0@lo:400:kworker.0 00010000:00080000:3.0:1790391271.322889:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f6bb80 x1877361130778112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391271.322898:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130778112:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.322927:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777600 00000100:00100000:3.0:1790391271.322931:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777600 00000100:00100000:3.0:1790391271.322956:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391271.322962:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.323003:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130777600:12345-0@lo:400:kworker.0 Request processed in 40us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.323009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391271.323060:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130777600:0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.323099:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777472 00000100:00100000:3.0:1790391271.323103:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777472 00000100:00100000:3.0:1790391271.323127:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790391271.323133:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130777472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.323166:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130777472:12345-0@lo:400:kworker.0 Request processed in 33us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.323172:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790391271.323218:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130777472:0@lo:400:kworker.0 00000100:00100000:2.0:1790391271.323597:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391271.324044:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130777856 00000100:00100000:3.0:1790391271.324051:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130777856 00000100:00080000:2.0:1790391271.324150:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391271.324819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391271.324832:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391271.324912:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130777856:12345-0@lo:400:kworker.0 Request processed in 84us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.324919:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790391271.325010:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130777856:0@lo:400:kworker.0 00000100:00100000:0.0:1790391271.325958:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391271.325973:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130778240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391271.326040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391271.326080:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130778240 00000100:00100000:0.0:1790391271.326087:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130778240 00000100:00100000:0.0:1790391271.326127:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790391271.326137:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130778240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391271.326168:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391271.326208:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130778240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391271.326215:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1790391271.326248:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f38000 x1877361130778240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391271.326266:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130778240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391271.700708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391271.702091:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108725376 00000100:00100000:0.0:1790391271.702113:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108725376 00000100:00100000:0.0:1790391271.702192:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 220 00000100:00100000:0.0:1790391271.702209:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108725376:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391271.702311:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108725376:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 108us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391271.702320:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 220 00000100:00100000:1.0:1790391271.707166:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391271.707355:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108725504 00000100:00100000:3.0:1790391271.707368:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108725504 00000100:00100000:3.0:1790391271.707502:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:3.0:1790391271.707514:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108725504:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391271.707617:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108725504:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 104us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.707864:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:1.0:1790391271.708401:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391271.708436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391271.708464:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391271.708487:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108725888 00000100:00100000:1.0:1790391271.708496:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108725888 00000100:00100000:3.0:1790391271.708542:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108725632 00000100:00100000:3.0:1790391271.708545:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108725632 00000100:00080000:0.0:1790391271.708730:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391271.708737:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391271.708942:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108725760 00000100:00100000:1.0:1790391271.708946:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108725760 00000100:00100000:1.0:1790391271.708974:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:1.0:1790391271.708982:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108725888:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391271.709073:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108725888:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 92us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391271.709084:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:1.0:1790391271.709100:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391271.709106:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108725760:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391271.709130:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108725760:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391271.709135:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:3.0:1790391271.709914:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:3.0:1790391271.709926:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108725632:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391271.709980:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108725632:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 57us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391271.709988:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00080000:0.0:1790391271.710841:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391271.769580:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790391272.554263:0:10328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1790391272.799311:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391273.369490:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130778368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391273.369587:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391273.369771:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130778368 00000100:00100000:3.0:1790391273.369783:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130778368 00000100:00100000:3.0:1790391273.369872:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391273.369902:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130778368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391273.369951:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391273.370006:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130778368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391273.370040:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790391273.370220:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391273.370272:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03e680 x1877361130778368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391273.370295:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130778368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391273.818398:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391274.842275:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391275.865243:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391276.447048:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391276.447074:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130778496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391276.447153:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.453216:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130778496 00000100:00100000:3.0:1790391276.453232:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130778496 00000100:00100000:3.0:1790391276.453336:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391276.453352:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130778496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391276.453400:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391276.453501:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130778496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (6347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.453508:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790391276.458516:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130778624:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.458592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.458640:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130779136:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.458669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.458709:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391276.458715:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130778752:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.458737:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.458767:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779136 00000100:00100000:0.0:1790391276.458776:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779136 00000100:00100000:0.0:1790391276.458823:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130778752 00000100:00100000:0.0:1790391276.458826:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130778752 00000100:00100000:0.0:1790391276.458849:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790391276.458858:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130779136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.458909:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130779136:12345-0@lo:400:kworker.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.458916:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790391276.458935:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790391276.458941:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130778752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.458968:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130778752:12345-0@lo:400:kworker.0 Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.458974:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790391276.459001:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130779008:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.459080:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.459115:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391276.459122:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130778880:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.459158:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.459189:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130778880 00000100:00100000:0.0:1790391276.459193:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130778880 00000100:00100000:0.0:1790391276.459231:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790391276.459239:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130778880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.459279:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130778880:12345-0@lo:400:kworker.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.459285:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1790391276.459323:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f722d80 x1877361130778880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391276.459338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130778880:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.459361:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779008 00000100:00100000:0.0:1790391276.459364:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779008 00000100:00100000:0.0:1790391276.459389:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790391276.459395:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130779008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.459433:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130779008:12345-0@lo:400:kworker.0 Request processed in 38us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.459439:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790391276.459466:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130779008:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.459489:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130778752:0@lo:400:kworker.0 00000100:00100000:0.0:1790391276.459498:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130779136:0@lo:400:kworker.0 00000100:00080000:1.0:1790391276.459673:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391276.459679:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391276.459693:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790391276.459730:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa75f80 x1877361130778496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391276.459747:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130778496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391276.460413:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130778624 00000100:00100000:3.0:1790391276.460421:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130778624 00000100:00100000:3.0:1790391276.460470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1790391276.460479:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130778624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391276.460539:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130778624:12345-0@lo:400:kworker.0 Request processed in 63us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.460546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1790391276.460588:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130778624:0@lo:400:kworker.0 00000100:00100000:3.0:1790391276.811944:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391276.813071:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391276.813119:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391276.813151:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391276.813174:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391276.813218:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726016 00000100:00100000:3.0:1790391276.813228:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726016 00000100:00100000:3.0:1790391276.813277:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 222 00000100:00100000:3.0:1790391276.813288:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108726016:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391276.813357:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108726016:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 71us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.813364:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 222 00000100:00100000:0.0:1790391276.813556:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726272 00000100:00100000:0.0:1790391276.813561:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726272 00000100:00100000:1.0:1790391276.813780:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726528 00000100:00100000:1.0:1790391276.813785:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726528 00000100:00100000:1.0:1790391276.813818:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726400 00000100:00100000:1.0:1790391276.813821:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726400 00000100:00100000:1.0:1790391276.813844:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:1.0:1790391276.813851:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108726528:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391276.813883:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108726528:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 32us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.813889:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:1.0:1790391276.813902:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:1.0:1790391276.813909:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108726400:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391276.813934:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108726400:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.813940:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:0.0:1790391276.814059:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726144 00000100:00100000:0.0:1790391276.814063:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726144 00000100:00100000:0.0:1790391276.814097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:0.0:1790391276.814104:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108726272:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391276.814133:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108726272:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.814139:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:0.0:1790391276.814152:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00100000:0.0:1790391276.814158:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108726144:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391276.814180:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108726144:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 22us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.814186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00080000:0.0:1790391276.814204:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391276.814208:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391276.814211:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790391276.889356:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391277.913862:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391278.489976:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391278.494780:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130779264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391278.494863:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391278.495235:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779264 00000100:00100000:3.0:1790391278.495245:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779264 00000100:00100000:3.0:1790391278.495313:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391278.495325:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130779264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391278.495366:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790391278.495545:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391278.495840:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130779264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 518us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391278.495850:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1790391278.498935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f05500 x1877361130779264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391278.498967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130779264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391278.939896:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391279.963161:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391280.987515:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391281.561239:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130779520:0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561311:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.561363:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130780032:0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561388:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.561418:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790391281.561424:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130779392:0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561451:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.561472:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130779904:0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561505:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.561535:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779520 00000100:00100000:3.0:1790391281.561554:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779520 00000100:00100000:3.0:1790391281.561619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779904 00000100:00100000:3.0:1790391281.561624:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779904 00000100:00100000:3.0:1790391281.561655:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391281.561664:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561714:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130779520:12345-0@lo:400:kworker.0 Request processed in 50us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.561721:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391281.561737:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790391281.561743:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130779904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561771:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130779904:12345-0@lo:400:kworker.0 Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.561778:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790391281.561795:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780032 00000100:00100000:3.0:1790391281.561798:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780032 00000100:00100000:3.0:1790391281.561823:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391281.561829:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130780032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561858:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130780032:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.561864:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391281.561881:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779392 00000100:00100000:3.0:1790391281.561885:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779392 00000100:00100000:3.0:1790391281.561907:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1790391281.561914:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130779392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.561942:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130779392:12345-0@lo:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.561948:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1790391281.561978:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391281.561988:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391281.562049:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130779392:0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.562065:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130779904:0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.562073:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130779520:0@lo:400:kworker.0 00010000:00080000:3.0:1790391281.562084:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f06300 x1877361130780032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391281.562094:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130780032:0@lo:400:kworker.0 00000100:00100000:2.0:1790391281.562462:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130779648:0@lo:400:kworker.0 00000100:00100000:2.0:1790391281.562522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391281.562558:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391281.562572:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130779776:0@lo:400:kworker.0 00000100:00100000:2.0:1790391281.562606:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391281.562638:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779776 00000100:00100000:2.0:1790391281.562643:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779776 00000100:00100000:2.0:1790391281.562674:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391281.562681:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130779776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391281.562712:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130779776:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391281.562727:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1790391281.562746:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391281.562768:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130779776:0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.563048:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130779648 00000100:00100000:3.0:1790391281.563054:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130779648 00000100:00100000:3.0:1790391281.563096:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391281.563103:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130779648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391281.563141:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130779648:12345-0@lo:400:kworker.0 Request processed in 39us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.563146:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1790391281.563217:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391281.563381:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130780160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391281.563411:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790391281.563443:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f05180 x1877361130779648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391281.563454:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130779648:0@lo:400:kworker.0 00000100:00100000:2.0:1790391281.563476:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780160 00000100:00100000:2.0:1790391281.563480:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780160 00000100:00100000:2.0:1790391281.563795:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391281.563803:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130780160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391281.563836:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391281.563922:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130780160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391281.563930:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1790391281.566866:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962411a18380 x1877361130780160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391281.566895:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130780160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391281.948957:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391281.948998:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391281.949049:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391281.949069:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391281.949095:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391281.949120:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727040 00000100:00100000:3.0:1790391281.949129:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727040 00000100:00100000:3.0:1790391281.949183:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727168 00000100:00100000:3.0:1790391281.949186:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727168 00000100:00100000:3.0:1790391281.949222:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1790391281.949233:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108727040:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391281.949297:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108727040:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 67us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.949317:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1790391281.949332:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1790391281.949337:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a5fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108727168:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391281.949359:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a5fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108727168:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 22us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.949364:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1790391281.949531:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726656 00000100:00100000:3.0:1790391281.949535:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726656 00000100:00100000:3.0:1790391281.949557:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 224 00000100:00100000:3.0:1790391281.949564:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108726656:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391281.949719:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726784 00000100:00100000:0.0:1790391281.949725:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726784 00000100:00100000:0.0:1790391281.949759:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108726912 00000100:00100000:0.0:1790391281.949761:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108726912 00000100:00100000:0.0:1790391281.949781:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:0.0:1790391281.949788:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108726784:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391281.949819:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108726784:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 32us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391281.949825:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:0.0:1790391281.949840:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:0.0:1790391281.949845:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108726912:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391281.949879:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108726912:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 33us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391281.949885:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:3.0:1790391281.950001:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108726656:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 437us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.950008:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 224 00000100:00080000:3.0:1790391281.950065:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391281.950071:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391281.950074:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391282.010770:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391283.035606:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391283.612200:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130780288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391283.612273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391283.612469:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780288 00000100:00100000:3.0:1790391283.612478:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780288 00000100:00100000:3.0:1790391283.612540:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391283.612549:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130780288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391283.612597:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391283.612643:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130780288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391283.612650:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1790391283.612759:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391283.612793:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f07800 x1877361130780288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391283.612813:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130780288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391284.067369:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391285.084397:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391286.110178:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391286.689265:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130780416:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689358:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391286.689400:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130780928:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689426:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391286.689465:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790391286.689471:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130780544:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689492:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391286.689507:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130781056:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689540:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391286.689569:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130780800:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689589:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391286.689604:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391286.689608:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130780672:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689626:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391286.689649:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780416 00000100:00100000:3.0:1790391286.689655:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780416 00000100:00100000:3.0:1790391286.689692:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790391286.689700:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130780416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689744:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130780416:12345-0@lo:400:kworker.0 Request processed in 43us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391286.689751:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790391286.689781:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780928 00000100:00100000:3.0:1790391286.689785:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780928 00000100:00100000:3.0:1790391286.689816:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780544 00000100:00100000:3.0:1790391286.689819:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780544 00000100:00100000:3.0:1790391286.689830:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780800 00000100:00100000:3.0:1790391286.689832:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780800 00000100:00100000:3.0:1790391286.689845:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391286.689858:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130780928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689889:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130780928:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391286.689894:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391286.689906:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391286.689912:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130780544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.689937:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130780544:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391286.689943:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391286.689969:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790391286.689975:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130780800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.690005:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130780800:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391286.690010:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790391286.690048:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781056 00000100:00100000:3.0:1790391286.690051:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781056 00000100:00100000:3.0:1790391286.690071:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130780672 00000100:00100000:3.0:1790391286.690073:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130780672 00000100:00100000:3.0:1790391286.690087:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391286.690092:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130781056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.690118:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130781056:12345-0@lo:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391286.690124:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391286.690133:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790391286.690138:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130780672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.690159:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130780672:12345-0@lo:400:kworker.0 Request processed in 21us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391286.690170:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1790391286.690192:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391286.690195:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391286.690198:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391286.690225:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f05880 x1877361130780672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391286.690238:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130780672:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.690248:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130780800:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.690269:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130780544:0@lo:400:kworker.0 00010000:00080000:3.0:1790391286.690277:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f04380 x1877361130781056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391286.690286:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130781056:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.690293:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130780416:0@lo:400:kworker.0 00000100:00100000:3.0:1790391286.690300:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130780928:0@lo:400:kworker.0 00000100:00100000:2.0:1790391286.694106:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130781184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391286.694167:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391286.694216:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781184 00000100:00100000:2.0:1790391286.694223:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781184 00000100:00100000:2.0:1790391286.694264:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391286.694273:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130781184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391286.694307:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391286.694348:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130781184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391286.694355:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1790391286.694397:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962411a18a80 x1877361130781184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391286.694415:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130781184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391287.052209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391287.052265:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391287.052294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391287.052315:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391287.052503:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727424 00000100:00100000:3.0:1790391287.052524:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727424 00000100:00100000:3.0:1790391287.052581:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727552 00000100:00100000:3.0:1790391287.052585:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727552 00000100:00100000:3.0:1790391287.052606:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:3.0:1790391287.052615:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108727424:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391287.052682:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108727424:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 68us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391287.052690:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:3.0:1790391287.052721:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 83 00000100:00100000:3.0:1790391287.052726:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108727552:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391287.052750:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108727552:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391287.052755:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 83 00000100:00080000:3.0:1790391287.052772:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391287.055899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391287.055964:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727296 00000100:00100000:1.0:1790391287.055975:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727296 00000100:00100000:1.0:1790391287.056045:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 226 00000100:00100000:1.0:1790391287.056055:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108727296:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391287.056135:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108727296:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 81us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391287.056142:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 226 00000100:00100000:1.0:1790391287.056182:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727680 00000100:00100000:1.0:1790391287.056186:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727680 00000100:00100000:1.0:1790391287.056217:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727808 00000100:00100000:1.0:1790391287.056221:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727808 00000100:00100000:1.0:1790391287.056242:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:1.0:1790391287.056250:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2362:x1877361108727680:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:1.0:1790391287.056279:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a7bb 00000100:00080000:1.0:1790391287.056289:0:6697:0:(import.c:65:import_set_state_nolock()) ffff962427e87800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391287.056327:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790391287.056907:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+2:2362:x1877361108727680:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 655us (4588us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391287.056915:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:1.0:1790391287.056933:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1790391287.056940:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2362:x1877361108727808:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:1.0:1790391287.056954:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a7c2 00000100:00080000:1.0:1790391287.056960:0:6697:0:(import.c:65:import_set_state_nolock()) ffff962427e82000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391287.056985:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790391287.058577:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+2:2362:x1877361108727808:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 1629us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391287.058589:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00010000:00010000:1.0:1790391287.058632:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391287.058639:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391287.058647:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391287.058651:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790391287.130259:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391288.153248:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391288.729828:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391288.729855:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130781312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391288.729940:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391288.730253:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781312 00000100:00100000:3.0:1790391288.730262:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781312 00000100:00100000:3.0:1790391288.730348:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790391288.730359:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130781312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391288.730394:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391288.730442:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130781312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391288.730449:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1790391288.730496:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f07b80 x1877361130781312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391288.730516:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130781312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391288.730725:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790391289.181456:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391289.707391:0:11028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1790391290.202000:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391291.230337:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790391291.400684:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0b40030-8079-4d0d-add3-36e0ceb183ab 00000020:00000080:0.0:1790391291.400695:0:6726:0:(genops.c:885:class_export_put()) final put ffff962427e81800/d0b40030-8079-4d0d-add3-36e0ceb183ab 00000020:00000080:0.0:1790391291.400730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff962427e81800/d0b40030-8079-4d0d-add3-36e0ceb183ab for lustre-OST0000 00000020:00000080:0.0:1790391291.400777:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962427e87800 for lustre-OST0000 00000001:00100000:0.0:1790391291.403418:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0b40030-8079-4d0d-add3-36e0ceb183ab 00000020:00000080:0.0:1790391291.403429:0:7657:0:(genops.c:885:class_export_put()) final put ffff962427e86000/d0b40030-8079-4d0d-add3-36e0ceb183ab 00000020:00000080:3.0:1790391291.404830:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff962427e86000/d0b40030-8079-4d0d-add3-36e0ceb183ab for lustre-OST0001 00000020:00000080:3.0:1790391291.404906:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962427e82000 for lustre-OST0001 00000100:00100000:0.0:1790391291.801353:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391291.801377:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130781440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391291.801458:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391291.801652:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781440 00000100:00100000:2.0:1790391291.801661:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781440 00000100:00100000:2.0:1790391291.801721:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391291.801731:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130781440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391291.801763:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391291.801807:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130781440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391291.801814:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1790391291.801877:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790391291.801911:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962411a18a80 x1877361130781440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391291.801932:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130781440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391291.802410:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130781824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391291.802456:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391291.802482:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391291.802503:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130781696:0@lo:400:kworker.0 00000100:00100000:2.0:1790391291.802530:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391291.802610:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130781568:0@lo:400:kworker.0 00000100:00100000:0.0:1790391291.802649:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391291.802685:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130782080:0@lo:400:kworker.0 00000100:00100000:0.0:1790391291.802708:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391291.802733:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391291.802739:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130781952:0@lo:400:kworker.0 00000100:00100000:0.0:1790391291.802762:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391291.802849:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781824 00000100:00100000:1.0:1790391291.802855:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781824 00000100:00100000:1.0:1790391291.802905:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790391291.802915:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130781824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391291.802976:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130781824:12345-0@lo:400:kworker.0 Request processed in 63us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391291.802984:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1790391291.803052:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962411a19f80 x1877361130781824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391291.803064:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130781824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391291.803184:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781568 00000100:00100000:2.0:1790391291.803188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781568 00000100:00100000:2.0:1790391291.803221:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790391291.803237:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130781568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391291.803273:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130781568:12345-0@lo:400:kworker.0 Request processed in 46us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391291.803279:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1790391291.803396:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391291.803415:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130781568:0@lo:400:kworker.0 00000100:00100000:3.0:1790391291.803497:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781696 00000100:00100000:3.0:1790391291.803502:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781696 00000100:00100000:3.0:1790391291.803538:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130782080 00000100:00100000:3.0:1790391291.803542:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130782080 00000100:00100000:3.0:1790391291.803566:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130781952 00000100:00100000:3.0:1790391291.803569:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130781952 00000100:00100000:3.0:1790391291.803584:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790391291.803590:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130781696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391291.803634:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130781696:12345-0@lo:400:kworker.0 Request processed in 45us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391291.803641:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790391291.803654:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391291.803660:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130782080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391291.803690:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130782080:12345-0@lo:400:kworker.0 Request processed in 31us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391291.803696:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391291.803705:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790391291.803710:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130781952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391291.803733:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130781952:12345-0@lo:400:kworker.0 Request processed in 23us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391291.803738:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790391291.803771:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130781696:0@lo:400:kworker.0 00000100:00100000:3.0:1790391291.803793:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130781952:0@lo:400:kworker.0 00000100:00100000:3.0:1790391291.803803:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130782080:0@lo:400:kworker.0 00000100:00080000:2.0:1790391291.803942:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391292.170749:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391292.170808:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391292.170885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391292.170914:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728064 00000100:00100000:3.0:1790391292.170924:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728064 00000100:00100000:3.0:1790391292.170980:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728192 00000100:00100000:3.0:1790391292.170984:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728192 00000100:00100000:3.0:1790391292.171008:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 87 00000100:00100000:3.0:1790391292.171039:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108728064:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391292.171125:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108728064:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 109us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391292.171135:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 87 00000100:00100000:3.0:1790391292.171153:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00100000:3.0:1790391292.171160:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108728192:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391292.171184:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108728192:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391292.171190:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00080000:3.0:1790391292.171207:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391292.174158:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108727936 00000100:00100000:2.0:1790391292.174174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108727936 00000100:00100000:2.0:1790391292.174227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 228 00000100:00100000:2.0:1790391292.174237:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108727936:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391292.174319:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108727936:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 83us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391292.174327:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 228 00010000:00010000:0.0:1790391292.254594:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391293.276440:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790391293.584214:0:11179:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7e031090 20000000:00000080:1.0:1790391293.584236:0:11179:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962439a02c00 uarg=0000000000000000 20000000:01000000:1.0:1790391293.584285:0:11179:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790391293.584292:0:11179:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790391293.584297:0:11179:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790391293.586174:0:11180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790391293.586985:0:11179:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790391293.599904:0:11179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790391293.600531:0:11179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600553:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600562:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a775 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600570:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a783 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600577:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a791 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600584:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600592:0:11179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600699:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600714:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 12 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.600742:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782208:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391293.600912:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a791 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.600930:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a791 expref: 18 pid: 5831 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.600939:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782336:0@lo:104: 00000100:00100000:0.0:1790391293.600975:0:11179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391293.601033:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a783 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.601042:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a783 expref: 18 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.601050:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782464:0@lo:104: 00000100:00100000:0.0:1790391293.601068:0:11179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391293.601085:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a775 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.601093:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a775 expref: 18 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.601100:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782592:0@lo:104: 00000100:00100000:0.0:1790391293.601129:0:11179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391293.601143:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.601161:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 12 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.601169:0:11179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782720:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391293.601189:0:11179:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391293.601612:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130782336 00000100:00100000:1.0:1790391293.601621:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130782336 00000100:00100000:2.0:1790391293.604765:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130782464 00000100:00100000:2.0:1790391293.604782:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130782464 00000100:00100000:1.0:1790391293.604896:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130782592 00000100:00100000:1.0:1790391293.604902:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130782592 00000100:00100000:3.0:1790391293.607324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391293.607549:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391293.608270:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728448 00000100:00100000:2.0:1790391293.608289:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728448 00010000:00010000:2.0:1790391293.608325:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 13 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391293.608357:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728320 00000100:00100000:2.0:1790391293.608360:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728320 00010000:00010000:2.0:1790391293.608372:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 14 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391293.608419:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:2.0:1790391293.608428:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962408360850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+14:2363:x1877361108728448:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391293.608443:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391293.608448:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 14 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391293.608459:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 14 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391293.608478:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391293.608526:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962408360850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+14:2363:x1877361108728448:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 98us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391293.608533:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:2.0:1790391293.608577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:2.0:1790391293.608582:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108728320:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391293.608589:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391293.608593:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 13 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391293.608604:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 13 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391293.608613:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391293.608771:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108728320:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 45us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391293.608779:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:2.0:1790391293.610444:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391293.610458:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:11179:x1877361130782336:12345-0@lo:104: 00010000:00010000:2.0:1790391293.610473:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391293.610536:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391293.610542:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:11179:x1877361130782336:12345-0@lo:104: Request processed in 89us (9567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391293.610548:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391293.610569:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391293.610575:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:11179:x1877361130782464:12345-0@lo:104: 00010000:00010000:2.0:1790391293.610583:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391293.610614:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391293.610619:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:11179:x1877361130782464:12345-0@lo:104: Request processed in 44us (9550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391293.610624:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391293.610649:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391293.610654:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:11179:x1877361130782592:12345-0@lo:104: 00010000:00010000:2.0:1790391293.610661:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391293.610683:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790391293.610688:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:11179:x1877361130782592:12345-0@lo:104: Request processed in 34us (9558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391293.610693:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1790391293.610826:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2200/0x35e94fc15449a7ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc3d expref: 12 pid: 5831 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.610849:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782208:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391293.610865:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782336:0@lo:104: 00000100:00100000:0.0:1790391293.610872:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782464:0@lo:104: 00000100:00100000:0.0:1790391293.610878:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782592:0@lo:104: 00010000:00010000:0.0:1790391293.610886:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a0200/0x35e94fc15449a76e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc05 expref: 11 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.610895:0:11179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1877361130782720:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391293.610933:0:11179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611164:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790391293.611171:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611178:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391293.611182:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611213:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391293.611220:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391293.611226:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391293.611262:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611268:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391293.611299:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611306:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e30400/0x35e94fc15449a791 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a798 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611316:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391293.611319:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611324:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391293.611327:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611333:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391293.611339:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391293.611350:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391293.611363:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611369:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391293.611375:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611381:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96243a2e2e00/0x35e94fc15449a783 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a78a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611389:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391293.611392:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611396:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391293.611410:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611416:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391293.611422:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391293.611426:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391293.611438:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611443:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391293.611465:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611472:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e30e00/0x35e94fc15449a775 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a77c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.611484:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391293.611486:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391293.611487:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391293.611502:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130782848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391293.611543:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391293.611580:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391293.611586:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130782976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391293.611606:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391293.611822:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130783104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391293.611860:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391293.611894:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130782848 00000100:00100000:0.0:1790391293.611901:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130782848 00010000:00010000:0.0:1790391293.612110:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a791 expref: 19 pid: 5831 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.612132:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130782976 00000100:00100000:0.0:1790391293.612135:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130782976 00010000:00010000:0.0:1790391293.612148:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a783 expref: 20 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.612158:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130783104 00000100:00100000:0.0:1790391293.612161:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130783104 00010000:00010000:0.0:1790391293.612172:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a775 expref: 21 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391293.612262:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391293.612421:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+21:3307:x1877361130782848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391293.612436:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391293.612442:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a791 expref: 21 pid: 5831 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612453:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a791 expref: 21 pid: 5831 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612466:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e31600/0x35e94fc15449a798 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a791 expref: 21 pid: 5831 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612477:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391293.612511:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+20:3307:x1877361130782848:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391293.612518:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391293.612534:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391293.612540:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130782976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391293.612547:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391293.612551:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a783 expref: 19 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612559:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a783 expref: 19 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612568:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2800/0x35e94fc15449a78a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a783 expref: 19 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612587:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391293.612608:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+18:3307:x1877361130782976:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391293.612615:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391293.612626:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391293.612709:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+17:3309:x1877361130783104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391293.612717:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391293.612720:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a775 expref: 17 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612728:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a775 expref: 17 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612737:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449a77c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a775 expref: 17 pid: 5830 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612747:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612754:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612767:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612773:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612780:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612792:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612798:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400030400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391293.612801:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612809:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612822:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.612831:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391293.612870:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+16:3309:x1877361130783104:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391293.612876:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391293.612909:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130782976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391293.613827:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130782848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391293.614092:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130783104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391293.614118:0:11179:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.614128:0:11179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391293.614136:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030400/0x35e94fc15449a7c9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391293.614325:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391293.849521:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391293.851853:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130783232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391293.851943:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391293.852165:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130783232 00000100:00100000:3.0:1790391293.852331:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130783232 00000100:00100000:3.0:1790391293.852459:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790391293.852469:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130783232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391293.852508:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391293.852568:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130783232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391293.852575:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790391293.852665:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f06680 x1877361130783232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391293.852687:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130783232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391293.852802:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391294.297434:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391295.326200:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790391295.449106:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391295.449115:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96243f8f8000 from 7 10000000:01000000:1.0:1790391295.449120:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391295.449177:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.449190:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.449212:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391295.449248:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.449326:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.449428:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f25540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.449832:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130783360 00000100:00100000:3.0:1790391295.449841:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130783360 00000100:00100000:3.0:1790391295.449930:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790391295.449940:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130783360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391295.449960:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391295.449975:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a7d0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.450000:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.450010:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.450042:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2000, rc 0) 00000100:00100000:3.0:1790391295.450095:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130783360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.450101:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1790391295.450191:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391295.450205:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.450211:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391295.450261:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.450282:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.450306:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.450445:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130783488 00000100:00100000:3.0:1790391295.450450:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130783488 00000100:00100000:3.0:1790391295.450579:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790391295.450598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130783488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391295.450869:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130783488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.450877:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790391295.450938:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.450968:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.451011:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.451285:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.451402:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130783616 00000100:00100000:1.0:1790391295.451407:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130783616 00000100:00100000:1.0:1790391295.451433:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790391295.451440:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130783616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.451818:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130783616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 376us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.451825:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1790391295.451936:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790391295.453119:0:11229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790391295.453301:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790391295.453454:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391295.453532:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.453544:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391295.453886:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391295.453897:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962439f98800 from 7 10000000:01000000:0.0:1790391295.453900:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391295.453942:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.453949:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.453959:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391295.453985:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.455589:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.455724:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.455777:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130783744 00000100:00100000:1.0:1790391295.455786:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130783744 00000100:00100000:1.0:1790391295.455876:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790391295.455886:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130783744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391295.455904:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391295.455923:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a7de expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.455952:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a7de expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.455963:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a7de expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.455989:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30800, rc 0) 00000100:00100000:1.0:1790391295.456060:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130783744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.456067:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1790391295.456151:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391295.456170:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.456179:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391295.456243:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.456272:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.456719:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.456776:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130783872 00000100:00100000:3.0:1790391295.456781:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130783872 00000100:00100000:3.0:1790391295.456811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790391295.456819:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130783872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391295.457120:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130783872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.457134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1790391295.457223:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130783872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.457256:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.457301:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.457336:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242e026d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.457554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784000 00000100:00100000:3.0:1790391295.457559:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784000 00000100:00100000:3.0:1790391295.457598:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790391295.457605:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130784000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391295.457757:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130784000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.457764:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790391295.457841:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391295.459978:0:11230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790391295.460227:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790391295.460247:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391295.460257:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.460269:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391295.460279:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391295.460281:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9624081bf000 from 7 10000000:01000000:1.0:1790391295.460284:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391295.460328:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.460336:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.460347:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391295.460379:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.460450:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.460614:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.460673:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784128 00000100:00100000:0.0:1790391295.460681:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784128 00000100:00100000:0.0:1790391295.460726:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790391295.460736:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130784128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391295.460749:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391295.460762:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a7ec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.460785:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.460796:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.460803:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031a00, rc 0) 00000100:00100000:0.0:1790391295.460840:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130784128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.460846:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790391295.460999:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391295.461047:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.461056:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391295.461106:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.461143:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.461164:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.461216:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784256 00000100:00100000:0.0:1790391295.461220:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784256 00000100:00100000:0.0:1790391295.461248:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790391295.461254:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130784256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.461583:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130784256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.461590:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790391295.461755:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.461783:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.461819:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.461850:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f25d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.461894:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784384 00000100:00100000:0.0:1790391295.461904:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784384 00000100:00100000:0.0:1790391295.461933:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790391295.461940:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130784384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.462092:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130784384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.462099:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790391295.462173:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130784384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790391295.476310:0:11231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790391295.478937:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790391295.478980:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391295.478992:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.479004:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391295.562458:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391295.562549:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728576 00000100:00100000:1.0:1790391295.562559:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728576 00000100:00100000:1.0:1790391295.562619:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 238 00000100:00100000:1.0:1790391295.562630:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+11:5605:x1877361108728576:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391295.562648:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391295.562667:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.562696:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.562707:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.562731:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31c00, rc 0) 00000100:00100000:1.0:1790391295.562796:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108728576:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 168us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.562803:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 238 00000100:00100000:1.0:1790391295.566242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391295.566314:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728704 00000100:00100000:3.0:1790391295.566325:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728704 00000100:00100000:3.0:1790391295.566387:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 239 00000100:00100000:3.0:1790391295.566398:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108728704:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391295.566682:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108728704:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 284us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.566691:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 239 00000100:00100000:3.0:1790391295.568855:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391295.572379:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728832 00000100:00100000:1.0:1790391295.572508:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728832 00000100:00100000:1.0:1790391295.572753:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 240 00000100:00100000:1.0:1790391295.572765:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108728832:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.572996:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108728832:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 234us (4148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.573004:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 240 00000100:00100000:1.0:1790391295.597527:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391295.597971:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108728960 00000100:00100000:0.0:1790391295.597982:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108728960 00000100:00100000:0.0:1790391295.598049:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 241 00000100:00100000:0.0:1790391295.598059:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108728960:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391295.598075:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391295.598093:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.598137:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.598149:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.598159:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031600, rc 0) 00000100:00100000:0.0:1790391295.598278:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108728960:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 220us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.598285:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 241 00000100:00100000:1.0:1790391295.610701:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391295.610836:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729088 00000100:00100000:0.0:1790391295.610847:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729088 00000100:00100000:0.0:1790391295.610905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 242 00000100:00100000:0.0:1790391295.610915:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108729088:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391295.611251:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108729088:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 335us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.611259:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 242 00000100:00100000:3.0:1790391295.613935:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391295.614047:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729216 00000100:00100000:1.0:1790391295.614063:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729216 00000100:00100000:1.0:1790391295.614113:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 243 00000100:00100000:1.0:1790391295.614123:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108729216:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391295.614348:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108729216:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 225us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.614356:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 243 00010000:00010000:3.0:1790391296.347902:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391296.921491:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130784512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391296.921562:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391296.921650:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784512 00000100:00100000:1.0:1790391296.921681:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784512 00000100:00100000:1.0:1790391296.921736:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790391296.921746:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130784512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391296.921779:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391296.921822:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130784512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391296.921830:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1790391296.921925:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790391296.921957:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa75500 x1877361130784512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391296.921975:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130784512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391296.924434:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130784768:0@lo:400:kworker.0 00000100:00100000:0.0:1790391296.924496:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391296.924532:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391296.924538:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130784896:0@lo:400:kworker.0 00000100:00100000:0.0:1790391296.924566:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391296.924602:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784768 00000100:00100000:0.0:1790391296.924609:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784768 00000100:00100000:0.0:1790391296.924660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790391296.924670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130784768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391296.924718:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130784768:12345-0@lo:400:kworker.0 Request processed in 50us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391296.924725:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790391296.924749:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784896 00000100:00100000:0.0:1790391296.924753:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784896 00000100:00100000:0.0:1790391296.924785:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391296.924792:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130784896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391296.924836:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130784896:12345-0@lo:400:kworker.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391296.924842:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1790391296.924864:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391296.924889:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439989880 x1877361130784896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391296.924903:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130784896:0@lo:400:kworker.0 00000100:00100000:0.0:1790391296.924915:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130784768:0@lo:400:kworker.0 00000100:00100000:0.0:1790391296.924936:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130785024:0@lo:400:kworker.0 00000100:00100000:1.0:1790391296.925056:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130784640:0@lo:400:kworker.0 00000100:00100000:1.0:1790391296.925256:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391296.925288:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130785152:0@lo:400:kworker.0 00000100:00100000:1.0:1790391296.925312:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391296.925354:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130784640 00000100:00100000:1.0:1790391296.925359:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130784640 00000100:00100000:1.0:1790391296.925387:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790391296.925395:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130784640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391296.925430:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130784640:12345-0@lo:400:kworker.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391296.925437:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790391296.925462:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785152 00000100:00100000:1.0:1790391296.925466:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785152 00000100:00100000:1.0:1790391296.925495:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790391296.925502:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130785152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391296.925540:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130785152:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391296.925546:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790391296.925579:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130784640:0@lo:400:kworker.0 00000100:00100000:1.0:1790391296.925590:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130785152:0@lo:400:kworker.0 00000100:00100000:0.0:1790391296.925680:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790391296.925706:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391296.925748:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785024 00000100:00100000:1.0:1790391296.925752:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785024 00000100:00100000:1.0:1790391296.925787:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790391296.925793:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130785024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391296.925825:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130785024:12345-0@lo:400:kworker.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391296.925831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1790391296.925879:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391296.925897:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130785024:0@lo:400:kworker.0 00000100:00100000:3.0:1790391297.293161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391297.293208:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391297.293242:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391297.293554:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729472 00000100:00100000:1.0:1790391297.293563:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729472 00000100:00100000:1.0:1790391297.293630:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729600 00000100:00100000:1.0:1790391297.293634:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729600 00000100:00100000:1.0:1790391297.293660:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00100000:1.0:1790391297.293670:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108729472:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391297.293744:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108729472:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 75us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391297.293752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00100000:1.0:1790391297.293769:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 93 00000100:00100000:1.0:1790391297.293776:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108729600:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391297.293802:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108729600:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391297.293824:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 93 00000100:00080000:3.0:1790391297.294533:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391297.294623:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729344 00000100:00100000:2.0:1790391297.294631:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729344 00000100:00100000:2.0:1790391297.294665:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 245 00000100:00100000:2.0:1790391297.294673:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108729344:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391297.294723:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108729344:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 50us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391297.294730:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 245 00010000:00010000:1.0:1790391297.369412:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391298.236105:0:11377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790391298.394609:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391298.969576:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391298.969621:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130785280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391298.969738:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391298.970272:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785280 00000100:00100000:3.0:1790391298.970281:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785280 00000100:00100000:3.0:1790391298.970504:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790391298.970530:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130785280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391298.970592:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391298.970667:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130785280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391298.970674:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1790391298.970744:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391298.970860:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f05180 x1877361130785280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391298.970882:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130785280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391299.421945:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391300.441863:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391301.465264:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391302.041364:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391302.041389:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130785408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391302.041477:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391302.041552:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785408 00000100:00100000:0.0:1790391302.041561:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785408 00000100:00100000:0.0:1790391302.041616:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790391302.041625:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130785408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391302.041658:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391302.041703:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130785408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391302.041727:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1790391302.041755:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790391302.041788:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243fa75c00 x1877361130785408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391302.041806:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130785408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391302.042312:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130785664:0@lo:400:kworker.0 00000100:00100000:0.0:1790391302.042327:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130785536:0@lo:400:kworker.0 00000100:00100000:2.0:1790391302.042356:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391302.042373:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391302.042413:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130786048:0@lo:400:kworker.0 00000100:00100000:2.0:1790391302.042415:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130785920:0@lo:400:kworker.0 00000100:00100000:2.0:1790391302.042447:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391302.042471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391302.042474:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391302.042482:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130785792:0@lo:400:kworker.0 00000100:00100000:0.0:1790391302.042511:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785536 00000100:00100000:2.0:1790391302.042513:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391302.042519:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785536 00000100:00100000:2.0:1790391302.042549:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785664 00000100:00100000:2.0:1790391302.042555:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785664 00000100:00100000:0.0:1790391302.042558:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790391302.042569:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130785536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391302.042590:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785920 00000100:00100000:2.0:1790391302.042595:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785920 00000100:00100000:0.0:1790391302.042626:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130785536:12345-0@lo:400:kworker.0 Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391302.042634:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786048 00000100:00100000:0.0:1790391302.042634:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790391302.042640:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786048 00000100:00100000:0.0:1790391302.042670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790391302.042726:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790391302.042768:0:8292:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790391302.042775:0:8292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1790391302.042791:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130785792 00000100:00100000:2.0:1790391302.042794:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130785792 00000100:00100000:2.0:1790391302.042824:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391302.042830:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130785792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391302.042870:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130785792:12345-0@lo:400:kworker.0 Request processed in 40us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391302.042875:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391302.042899:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790391302.042906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790391302.050488:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130785664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391302.050593:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130785664:12345-0@lo:400:kworker.0 Request processed in 7916us (8238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391302.050604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790391302.050663:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130785536:0@lo:400:kworker.0 00000100:00080000:3.0:1790391302.050942:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391302.050948:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391302.051077:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130785664:0@lo:400:kworker.0 00010000:00080000:3.0:1790391302.051106:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439942d80 x1877361130785792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391302.051116:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130785792:0@lo:400:kworker.0 00000100:00100000:1.0:1790391302.056535:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130785920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391302.057181:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130785920:12345-0@lo:400:kworker.0 Request processed in 14444us (14730us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391302.057193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790391302.057281:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130785920:0@lo:400:kworker.0 00000100:00100000:2.0:1790391302.059467:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130786048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391302.060476:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130786048:12345-0@lo:400:kworker.0 Request processed in 17560us (18003us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391302.060489:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790391302.072968:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130786048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391302.413729:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391302.413764:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391302.413850:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391302.413888:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729984 00000100:00100000:1.0:1790391302.413897:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729984 00000100:00100000:1.0:1790391302.413950:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729856 00000100:00100000:1.0:1790391302.413953:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729856 00000100:00100000:1.0:1790391302.413978:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 97 00000100:00100000:1.0:1790391302.413988:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108729984:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391302.414091:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108729984:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391302.414111:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 97 00000100:00100000:1.0:1790391302.414130:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 98 00000100:00100000:1.0:1790391302.414137:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108729856:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391302.414166:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108729856:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391302.414173:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 98 00000100:00100000:2.0:1790391302.414533:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108729728 00000100:00100000:2.0:1790391302.414538:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108729728 00000100:00100000:2.0:1790391302.414580:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 247 00000100:00100000:2.0:1790391302.414588:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108729728:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391302.414622:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2364:x1877361108729728:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 36us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391302.414630:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 247 00000100:00080000:3.0:1790391302.415185:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391302.490620:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391303.046446:0:11479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:55:01 (1790391301) === 00000100:00100000:1.0:1790391303.370732:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391303.370789:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391303.371104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108730240 00000100:00100000:0.0:1790391303.371128:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108730240 00000100:00100000:0.0:1790391303.371197:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:0.0:1790391303.371208:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:9706:x1877361108730240:12345-192.168.201.8@tcp:700:mkdir.0 00000100:00100000:0.0:1790391303.372278:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:9706:x1877361108730240:12345-192.168.201.8@tcp:700:mkdir.0 Request processed in 1065us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391303.372290:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391303.372645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108730112 00000100:00100000:2.0:1790391303.372654:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108730112 00000100:00100000:2.0:1790391303.372696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391303.372716:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108730112:12345-192.168.201.8@tcp:41:mkdir.0 00000004:00000024:2.0:1790391303.372753:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790391303.372873:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108730112:12345-192.168.201.8@tcp:41:mkdir.0 Request processed in 158us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.372880:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391303.408472:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391303.408890:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108730496 00000100:00100000:1.0:1790391303.408917:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108730496 00000100:00100000:1.0:1790391303.409001:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:1.0:1790391303.409060:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:9706:x1877361108730496:12345-192.168.201.8@tcp:36:mkdir.0 00010000:00010000:1.0:1790391303.409143:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391303.413530:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a6e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbf0 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.413560:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751e00) 00010000:00010000:1.0:1790391303.413590:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391303.413976:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.413991:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.414002:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.414495:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.414504:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.414512:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391303.417494:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790391303.417516:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.417526:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.417534:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.417541:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391303.417546:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.417555:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.417573:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624119e7e00) 00010000:00010000:1.0:1790391303.417577:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391303.417582:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.417600:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a808 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391303.417623:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2bff805 reply state 00000000a8cc0d46 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391303.417632:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391303.417774:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:9706:x1877361108730496:12345-192.168.201.8@tcp:36:mkdir.0 Request processed in 8758us (9314us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790391303.417783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00010000:00010000:0.0:1790391303.422870:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.422891:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.422900:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.422906:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391303.422912:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.422920:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.422939:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9624119e7200) 00010000:00010000:0.0:1790391303.422943:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391303.422948:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.422955:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a80f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391303.442148:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391303.445097:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108730624 00000100:00100000:3.0:1790391303.445115:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108730624 00000100:00100000:0.0:1790391303.449754:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:0.0:1790391303.449777:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:9707:x1877361108730624:12345-192.168.201.8@tcp:101:chmod.0 00010000:00010000:0.0:1790391303.449797:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391303.449816:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc75 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.449885:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a81d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.449897:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a81d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.449906:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a81d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391303.449934:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790391303.449937:0:11443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391303.449965:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a81d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.449984:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc75 expref: 8 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.449997:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a81d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc75 expref: 7 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.450003:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751c00) 00010000:00010000:0.0:1790391303.450005:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391303.450008:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031800, rc 0) 00000100:00100000:0.0:1790391303.450116:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:9707:x1877361108730624:12345-192.168.201.8@tcp:101:chmod.0 Request processed in 340us (7978us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391303.450132:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:3.0:1790391303.456216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391303.456602:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108730880 00000100:00100000:1.0:1790391303.456612:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108730880 00000100:00100000:1.0:1790391303.456678:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1790391303.456690:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:9707:x1877361108730880:12345-192.168.201.8@tcp:36:chmod.0 00010000:00010000:1.0:1790391303.456763:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391303.456792:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a81d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc75 expref: 7 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.456813:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751c00) 00010000:00010000:1.0:1790391303.456827:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391303.456856:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.456870:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.456880:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391303.457651:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000510f9388 reply state 00000000b6f70ad3 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391303.457665:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790391303.457675:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790391303.457779:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:9707:x1877361108730880:12345-192.168.201.8@tcp:36:chmod.0 Request processed in 1090us (1573us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790391303.457788:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00010000:00010000:2.0:1790391303.461741:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.461761:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.461769:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.461776:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.461782:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.461791:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.461811:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624119e7e00) 00010000:00010000:2.0:1790391303.461814:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391303.461820:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.461827:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a824 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391303.496803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391303.497521:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108731008 00000100:00100000:1.0:1790391303.497534:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108731008 00000100:00100000:1.0:1790391303.497605:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1790391303.497615:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:9708:x1877361108731008:12345-192.168.201.8@tcp:101:chown.0 00010000:00010000:1.0:1790391303.497650:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391303.497674:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a82b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc7c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.497745:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449a832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.497758:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449a832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.497769:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449a832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391303.497804:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391303.497808:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391303.497847:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449a832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.497893:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a82b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc7c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.497913:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449a832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc7c expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.497922:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624119e7800) 00010000:00010000:1.0:1790391303.497925:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391303.497929:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30600, rc 0) 00000100:00100000:1.0:1790391303.498000:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:9708:x1877361108731008:12345-192.168.201.8@tcp:101:chown.0 Request processed in 386us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391303.498008:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1790391303.503373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.503533:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108731136 00000100:00100000:2.0:1790391303.503544:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108731136 00000100:00100000:2.0:1790391303.503604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:2.0:1790391303.503616:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:9708:x1877361108731136:12345-192.168.201.8@tcp:101:chown.0 00010000:00010000:2.0:1790391303.503635:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391303.503656:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc83 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503729:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503753:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503768:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503783:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503791:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503799:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503892:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a84e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503900:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a84e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503921:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a84e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391303.503954:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790391303.503958:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391303.503981:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a84e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.503994:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504001:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504007:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504038:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.504043:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504053:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504065:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624119e7800) 00010000:00010000:2.0:1790391303.504068:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391303.504073:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504079:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504103:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504108:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504114:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504120:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.504123:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504129:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504136:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96240bf85f00) 00010000:00010000:2.0:1790391303.504139:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391303.504142:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504147:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a847 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504181:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc83 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504192:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a84e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc83 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.504210:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85900) 00010000:00010000:2.0:1790391303.504212:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391303.504214:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a1400, rc 0) 00000100:00100000:2.0:1790391303.505863:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:9708:x1877361108731136:12345-192.168.201.8@tcp:101:chown.0 Request processed in 2239us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.505876:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:2.0:1790391303.509548:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391303.509643:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108731392 00000100:00100000:1.0:1790391303.509654:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108731392 00000100:00100000:1.0:1790391303.509752:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:1.0:1790391303.509763:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:9708:x1877361108731392:12345-192.168.201.8@tcp:36:chown.0 00010000:00010000:1.0:1790391303.509818:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391303.509851:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a84e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc83 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.509867:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85900) 00010000:00010000:1.0:1790391303.509877:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391303.509901:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.509914:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.509948:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.519747:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790391303.546374:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1790391303.551327:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e5a2a33 reply state 0000000077ab5409 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391303.551346:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790391303.551363:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1790391303.551488:0:8292:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1790391303.551517:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:9708:x1877361108731392:12345-192.168.201.8@tcp:36:chown.0 Request processed in 41752us (42077us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790391303.551527:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00010000:00010000:2.0:1790391303.551727:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.551737:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.551745:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.551751:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.551756:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.551763:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.551788:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9624119e7400) 00010000:00010000:2.0:1790391303.551791:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391303.551795:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.551801:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449a855 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391303.584823:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391303.584911:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108731520 00000100:00100000:0.0:1790391303.584920:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108731520 00000100:00100000:0.0:1790391303.584978:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:0.0:1790391303.584988:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:9709:x1877361108731520:12345-192.168.201.8@tcp:101:touch.500 00010000:00010000:0.0:1790391303.585010:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391303.585066:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a85c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc8a expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391303.586204:0:11443:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1080us 00010000:00010000:2.0:1790391303.618975:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619000:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619332:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619353:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619362:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619369:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619684:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619693:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619700:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391303.619722:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790391303.619725:0:11443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391303.619763:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619785:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619793:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619800:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619806:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.619811:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619820:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.619832:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624119e7800) 00010000:00010000:2.0:1790391303.620337:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391303.620346:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620354:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1000/0x35e94fc15449a863 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620369:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620375:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620381:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620394:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.620398:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620404:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620413:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96240bf85500) 00010000:00010000:2.0:1790391303.620415:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391303.620418:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620424:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449a86a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620469:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a85c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc8a expref: 8 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620486:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc8a expref: 7 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.620495:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:2.0:1790391303.620497:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790391303.620500:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0200, rc 0) 00000100:00100000:2.0:1790391303.620782:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:9709:x1877361108731520:12345-192.168.201.8@tcp:101:touch.500 Request processed in 35792us (35966us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.620792:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:3.0:1790391303.633900:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.635654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108731776 00000100:00100000:2.0:1790391303.635686:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108731776 00000100:00100000:2.0:1790391303.635758:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:2.0:1790391303.635769:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:9709:x1877361108731776:12345-192.168.201.8@tcp:101:touch.500 00010000:00010000:2.0:1790391303.635787:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391303.635807:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a878 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc91 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.642048:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.642074:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.642087:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.642116:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.642124:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.642139:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391303.642987:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1790391303.643545:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a88d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643558:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643595:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643633:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643641:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643648:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643654:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.643658:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643693:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643725:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:2.0:1790391303.643729:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391303.643733:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643752:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a87f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391303.643764:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5ce493d reply state 0000000094b948ca transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391303.643788:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790391303.643841:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1400/0x35e94fc15449a878 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc91 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643856:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a88d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc91 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.643865:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96240bf85800) 00010000:00010000:2.0:1790391303.643867:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391303.643870:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11800, rc 0) 00000100:00100000:2.0:1790391303.644782:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:9709:x1877361108731776:12345-192.168.201.8@tcp:101:touch.500 Request processed in 9010us (10888us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790391303.644803:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 22 00010000:00010000:3.0:1790391303.648390:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.648407:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.648415:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.648441:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391303.648446:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.648454:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.648472:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9e38752 (ffff96240bf85e00) 00010000:00010000:3.0:1790391303.648475:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391303.648480:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.648487:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449a886 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391303.649131:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391303.649381:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108732032 00000100:00100000:1.0:1790391303.649391:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108732032 00000100:00100000:1.0:1790391303.649447:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:1.0:1790391303.649457:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:9709:x1877361108732032:12345-192.168.201.8@tcp:36:touch.500 00010000:00010000:1.0:1790391303.649512:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391303.649531:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a88d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc91 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.649546:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96240bf85800) 00010000:00010000:1.0:1790391303.649554:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391303.649598:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.649611:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.649621:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391303.649752:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abcec5db reply state 000000004252349d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391303.649761:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391303.649963:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:9709:x1877361108732032:12345-192.168.201.8@tcp:36:touch.500 Request processed in 506us (845us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790391303.649985:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 23 00010000:00010000:2.0:1790391303.655742:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.655761:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.655769:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.655776:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391303.655781:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.655789:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.655804:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9624119e7600) 00010000:00010000:2.0:1790391303.655807:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391303.655826:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.655833:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a89b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391303.657442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.657755:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108732160 00000100:00100000:2.0:1790391303.657766:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108732160 00000100:00100000:2.0:1790391303.657825:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:2.0:1790391303.657846:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:9709:x1877361108732160:12345-192.168.201.8@tcp:101:touch.500 00010000:00010000:2.0:1790391303.657869:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391303.657890:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a8a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc98 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.657962:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a8a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc98 expref: 10 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.657976:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a8a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc98 expref: 10 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.657994:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96240bf85500) 00010000:00010000:2.0:1790391303.657998:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391303.658001:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11200, rc 0) 00000100:00100000:2.0:1790391303.658407:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:9709:x1877361108732160:12345-192.168.201.8@tcp:101:touch.500 Request processed in 570us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.658415:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:0.0:1790391303.661714:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391303.661811:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108732288 00000100:00100000:1.0:1790391303.661820:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108732288 00000100:00100000:1.0:1790391303.661877:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1790391303.661885:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1877361108732288:12345-192.168.201.8@tcp:8:touch.500 00010000:00080000:1.0:1790391303.661916:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:1.0:1790391303.661944:0:6695:0:(genops.c:1385:class_connect()) connect: client df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f, cookie 0x35e94fc15449a8a9 00002000:00100000:1.0:1790391303.661955:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f/ffff96243a189800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391303.661979:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391303.662386:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790391303.662415:0:6695:0:(import.c:65:import_set_state_nolock()) ffff96243a18f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391303.662486:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2362:x1877361108732288:12345-192.168.201.8@tcp:8:touch.500 Request processed in 601us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391303.662495:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:0.0:1790391303.664715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.664798:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108732416 00000100:00100000:2.0:1790391303.664807:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108732416 00000100:00100000:2.0:1790391303.664879:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:2.0:1790391303.664901:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:0:x1877361108732416:12345-192.168.201.8@tcp:2:touch.500 00000100:00080000:3.0:1790391303.665419:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1790391303.708647:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000001:00080000:0.0:1790391303.708669:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1790391303.708965:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:0:x1877361108732416:12345-192.168.201.8@tcp:2:touch.500 Request processed in 44059us (44253us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790391303.708977:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1790391303.712195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.712296:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108732672 00000100:00100000:2.0:1790391303.712307:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108732672 00000100:00100000:2.0:1790391303.712368:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:2.0:1790391303.712378:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:9709:x1877361108732672:12345-192.168.201.8@tcp:35:touch.500 00000100:00100000:2.0:1790391303.712858:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:9709:x1877361108732672:12345-192.168.201.8@tcp:35:touch.500 Request processed in 480us (670us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790391303.712866:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:0.0:1790391303.727181:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.727333:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108732800 00000100:00100000:2.0:1790391303.727343:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108732800 00000100:00100000:1.0:1790391303.727554:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:1.0:1790391303.727568:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:9710:x1877361108732800:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:1.0:1790391303.727593:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391303.727612:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449a8b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fc9f expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.727679:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a8b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.727693:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.727720:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391303.727755:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391303.727759:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391303.727796:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.727822:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449a8b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc9f expref: 13 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.727911:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc9f expref: 12 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.727985:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:1.0:1790391303.727988:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391303.727992:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30e00, rc 0) 00000100:00100000:1.0:1790391303.728256:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:9710:x1877361108732800:12345-192.168.201.8@tcp:101:rm.0 Request processed in 691us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391303.728263:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:2.0:1790391303.731809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391303.731888:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108733056 00000100:00100000:3.0:1790391303.731900:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108733056 00000100:00100000:3.0:1790391303.731980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:3.0:1790391303.731990:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:9710:x1877361108733056:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:3.0:1790391303.732044:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391303.732071:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2a00/0x35e94fc15449a8be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fca6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391303.732189:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790391303.732353:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2a00/0x35e94fc15449a8be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fca6 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.732368:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624119e7800) 00010000:00010000:3.0:1790391303.732370:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391303.732376:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2a00/0x35e94fc15449a8be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fca6 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.732392:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2a00, rc 0) 00000100:00100000:3.0:1790391303.733503:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:9710:x1877361108733056:12345-192.168.201.8@tcp:101:rm.0 Request processed in 1506us (1697us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1790391303.733514:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:2.0:1790391303.738743:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391303.738965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108733184 00000100:00100000:3.0:1790391303.738976:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108733184 00000100:00100000:3.0:1790391303.739060:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:3.0:1790391303.739070:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:9710:x1877361108733184:12345-192.168.201.8@tcp:37:rm.0 00000100:00100000:2.0:1790391303.745643:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:9710:x1877361108733184:12345-192.168.201.8@tcp:37:rm.0 Request processed in 6563us (6914us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.745657:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:0.0:1790391303.749717:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.749831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108733440 00000100:00100000:2.0:1790391303.749902:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108733440 00000100:00100000:2.0:1790391303.749993:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:2.0:1790391303.750004:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407baac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:9710:x1877361108733440:12345-192.168.201.8@tcp:35:rm.0 00000100:00100000:2.0:1790391303.750460:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407baac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:9710:x1877361108733440:12345-192.168.201.8@tcp:35:rm.0 Request processed in 457us (752us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790391303.750542:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:0.0:1790391303.757222:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391303.757681:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108733696 00000100:00100000:2.0:1790391303.757692:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108733696 00000100:00100000:2.0:1790391303.757818:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:2.0:1790391303.757829:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:9710:x1877361108733696:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:2.0:1790391303.757866:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391303.757887:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449a8cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcad expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.757979:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a8d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.757994:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a8d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.758006:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a8d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391303.759084:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790391303.762349:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449a8cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcad expref: 17 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.762395:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a8d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcad expref: 16 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.762405:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:0.0:1790391303.762408:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391303.762412:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11400, rc 0) 00000100:00100000:0.0:1790391303.762706:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108733696:12345-192.168.201.8@tcp:101:rm.0 Request processed in 4877us (5493us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790391303.762715:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:1.0:1790391303.770101:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391303.770154:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108733824 00000100:00100000:0.0:1790391303.770165:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108733824 00000100:00100000:0.0:1790391303.770229:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:0.0:1790391303.770250:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108733824:12345-192.168.201.8@tcp:41:rm.0 00000004:00000024:0.0:1790391303.770321:0:8292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1790391303.770396:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108733824:12345-192.168.201.8@tcp:41:rm.0 Request processed in 148us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391303.770405:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:2.0:1790391303.783132:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391303.783685:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108733952 00000100:00100000:3.0:1790391303.783714:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108733952 00000100:00100000:3.0:1790391303.783790:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:3.0:1790391303.783804:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108733952:12345-192.168.201.8@tcp:101:rm.0 00010000:00010000:3.0:1790391303.783828:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391303.783863:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2a00/0x35e94fc15449a8e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcb4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.783963:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.783979:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.783992:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784009:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784057:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784065:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784169:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449a8f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784177:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784184:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391303.784210:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790391303.784213:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391303.784242:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784267:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784275:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784283:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784290:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784295:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391303.784299:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784307:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784319:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:3.0:1790391303.784322:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391303.784326:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784333:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a8e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784345:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784351:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784361:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784366:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391303.784369:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784375:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784382:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9e38752 (ffff962411373b00) 00010000:00010000:3.0:1790391303.784384:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391303.784387:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784392:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449a8ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784421:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2a00/0x35e94fc15449a8e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcb4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784433:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449a8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcb4 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.784441:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96240bf85500) 00010000:00010000:3.0:1790391303.784443:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391303.784446:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3800, rc 0) 00000100:00100000:3.0:1790391303.784519:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:9710:x1877361108733952:12345-192.168.201.8@tcp:101:rm.0 Request processed in 718us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391303.784534:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:2.0:1790391303.789126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391303.789603:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108734208 00000100:00100000:0.0:1790391303.789613:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108734208 00000100:00100000:0.0:1790391303.789674:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:0.0:1790391303.789684:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:9710:x1877361108734208:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:0.0:1790391303.789739:0:11443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790391303.789774:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449a8f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcb4 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789821:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11200/0x35e94fc15449a8a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc98 expref: 16 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789832:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96240bf85500) 00010000:00010000:0.0:1790391303.789851:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449a8b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc9f expref: 15 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789861:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:0.0:1790391303.789864:0:11443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391303.789886:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789898:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789907:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789921:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789928:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.789934:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790058:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790076:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790083:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391303.790806:0:11443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790391303.790818:0:11443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339124801396ns, next at 340124799424ns, rc = 0 00010000:00010000:0.0:1790391303.790874:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790885:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790892:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790899:0:11443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790905:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790910:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790940:0:11443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391303.790958:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790964:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790978:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790983:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391303.790987:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.790994:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791004:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391303.791007:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790391303.791011:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791039:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449a90b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791056:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791062:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791067:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791071:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400030400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391303.791074:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791090:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791099:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:0.0:1790391303.791101:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391303.791104:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.791110:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449a8fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391303.791120:0:11443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c42ec2a1 reply state 0000000092d83445 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391303.791129:0:11443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391303.791218:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108734208:12345-192.168.201.8@tcp:36:rm.0 Request processed in 1533us (2098us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790391303.791226:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 30 00010000:00010000:2.0:1790391303.791562:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391303.791570:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.791576:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217a600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391303.791579:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.791586:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.791595:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391303.791598:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790391303.791601:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.791619:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a912 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.791636:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391303.791638:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391303.791640:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391303.795349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391303.795870:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108734464 00000100:00100000:0.0:1790391303.795882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108734464 00000100:00100000:0.0:1790391303.795943:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1790391303.795954:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108734464:12345-192.168.201.8@tcp:35:rm.0 00010000:00010000:3.0:1790391303.796205:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.796216:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.796224:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.796260:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391303.796266:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.796275:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.796290:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9e38752 (ffff962430751100) 00010000:00010000:3.0:1790391303.796294:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391303.796299:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391303.796305:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449a904 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9e38752 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391303.796911:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108734464:12345-192.168.201.8@tcp:35:rm.0 Request processed in 953us (1565us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790391303.796921:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:3.0:1790391303.806579:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391303.806724:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108734720 00000100:00100000:0.0:1790391303.806734:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108734720 00000100:00100000:0.0:1790391303.806803:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:0.0:1790391303.806828:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:9710:x1877361108734720:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:0.0:1790391303.806902:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790391303.806933:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a8d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcad expref: 16 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.806956:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0200/0x35e94fc15449a871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc8a expref: 15 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.806970:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:0.0:1790391303.806987:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449a832 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc7c expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.806994:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624119e7800) 00010000:00010000:0.0:1790391303.807000:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391303.807061:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807075:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807086:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807099:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807106:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807113:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807366:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807376:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.807382:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391303.808012:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790391303.808066:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808074:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808080:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808085:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217a600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391303.808089:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808096:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808106:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff962430751600) 00010000:00010000:0.0:1790391303.808108:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790391303.808112:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808127:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a600/0x35e94fc15449a927 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808147:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808152:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808158:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808162:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217b400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391303.808165:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808171:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808177:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751f00) 00010000:00010000:0.0:1790391303.808180:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391303.808182:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.808188:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96244217b400/0x35e94fc15449a919 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391303.808199:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfb17c76 reply state 00000000536c6124 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391303.808207:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391303.808300:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:9710:x1877361108734720:12345-192.168.201.8@tcp:36:rm.0 Request processed in 1472us (1730us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790391303.808309:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00010000:00010000:1.0:1790391303.809973:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.809987:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.809994:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.810011:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217a400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391303.810053:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.810063:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.810078:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff962430751900) 00010000:00010000:1.0:1790391303.810081:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391303.810085:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.810091:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96244217a400/0x35e94fc15449a920 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391304.090888:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391304.090914:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130786176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391304.090983:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391304.091080:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786176 00000100:00100000:0.0:1790391304.091088:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786176 00000100:00080000:3.0:1790391304.091343:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391304.091774:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790391304.091785:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130786176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391304.091811:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391304.091868:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130786176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391304.091875:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1790391304.091923:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962427f39c00 x1877361130786176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391304.091945:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130786176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391304.537972:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391305.562778:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391306.585474:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391307.168186:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391307.168256:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391307.168332:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786304 00000100:00100000:0.0:1790391307.168341:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786304 00000100:00100000:0.0:1790391307.168396:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790391307.168405:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130786304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391307.168441:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391307.168486:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130786304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391307.168505:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1790391307.168527:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790391307.168554:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03fb80 x1877361130786304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391307.168572:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391307.171386:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130786432:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.171455:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391307.171494:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130786944:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.171528:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391307.171554:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391307.171560:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130786816:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.171582:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391307.171619:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130786560:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.171641:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391307.171658:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391307.171663:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130786688:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.171687:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391307.171722:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786432 00000100:00100000:3.0:1790391307.171730:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786432 00000100:00100000:3.0:1790391307.171781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1790391307.171790:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130786432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.171836:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130786432:12345-0@lo:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391307.171843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1790391307.171872:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786944 00000100:00100000:3.0:1790391307.171876:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786944 00000100:00100000:3.0:1790391307.171907:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786816 00000100:00100000:3.0:1790391307.171910:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786816 00000100:00100000:3.0:1790391307.171925:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786560 00000100:00100000:3.0:1790391307.171928:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786560 00000100:00100000:3.0:1790391307.171939:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790391307.171945:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130786944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.171975:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130786944:12345-0@lo:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391307.171981:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790391307.172005:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790391307.172011:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130786816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.172060:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130786816:12345-0@lo:400:kworker.0 Request processed in 50us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391307.172066:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790391307.172076:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790391307.172081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130786560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.172111:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130786560:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391307.172116:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790391307.172137:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130786688 00000100:00100000:3.0:1790391307.172140:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130786688 00000100:00100000:3.0:1790391307.172165:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790391307.172171:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130786688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.172215:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130786688:12345-0@lo:400:kworker.0 Request processed in 43us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391307.172220:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1790391307.172257:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d862680 x1877361130786688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391307.172274:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130786688:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.172284:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130786560:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.172312:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130786816:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.172320:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962427f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130786432:0@lo:400:kworker.0 00000100:00100000:3.0:1790391307.172328:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130786944:0@lo:400:kworker.0 00000100:00080000:0.0:1790391307.172453:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391307.172459:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391307.537449:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391307.537496:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391307.537535:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391307.537574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391307.537608:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108734976 00000100:00100000:3.0:1790391307.537618:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108734976 00000100:00100000:0.0:1790391307.537778:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108735232 00000100:00100000:0.0:1790391307.537783:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108735232 00000100:00100000:0.0:1790391307.537819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 102 00000100:00100000:0.0:1790391307.537828:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:2363:x1877361108734976:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391307.537931:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:2363:x1877361108734976:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 104us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391307.537939:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 102 00000100:00100000:0.0:1790391307.537956:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 103 00000100:00100000:0.0:1790391307.537964:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108735232:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391307.537988:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108735104 00000100:00100000:0.0:1790391307.537991:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108735232:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391307.537995:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108735104 00000100:00100000:0.0:1790391307.538002:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 103 00000100:00100000:2.0:1790391307.538066:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00080000:0.0:1790391307.538069:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391307.538076:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2363:x1877361108735104:12345-192.168.201.8@tcp:400:kworker.0 00000100:00080000:0.0:1790391307.538077:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391307.538110:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2363:x1877361108735104:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 36us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391307.538117:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:1.0:1790391307.538493:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108734848 00000100:00100000:1.0:1790391307.538498:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108734848 00000100:00100000:1.0:1790391307.538539:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 249 00000100:00100000:1.0:1790391307.538547:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108734848:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391307.538575:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108734848:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 29us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391307.538582:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 249 00010000:00010000:2.0:1790391307.609458:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391308.634224:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391308.636490:0:11630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1790391308.766197:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1790391308.766214:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790391308.766362:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130787072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790391308.766434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391308.766505:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130787072 00000100:00100000:3.0:1790391308.766513:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130787072 00000100:00100000:3.0:1790391308.766556:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391308.766565:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130787072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790391308.766589:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1790391308.766620:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6ab73407, atime: 0x6ab73407, ctime: 0x6ab73407, blocks: 0x1 00010000:00010000:3.0:1790391308.766628:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.766645:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1790391308.766649:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391308.766656:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.766673:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.766701:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.766708:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.766726:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790391308.767302:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130787072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 736us (866us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790391308.767311:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1790391308.767340:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391308.767346:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.767355:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391308.767359:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.767370:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.767387:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.767395:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a626d248/0x35e94fc15449a92e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391308.767421:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391308.767423:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391308.767425:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790391308.767456:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96242d860a80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1790391308.767462:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130787072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790391309.210172:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130787200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391309.210244:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391309.210317:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130787200 00000100:00100000:0.0:1790391309.210335:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130787200 00000100:00100000:0.0:1790391309.210405:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391309.210415:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130787200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391309.210448:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391309.210488:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130787200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391309.210494:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790391309.210516:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391309.210556:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130787200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391309.658421:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790391309.907598:0:11680:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdeddf390 20000000:00000080:3.0:1790391309.907614:0:11680:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96242d9a7800 uarg=0000000000000000 20000000:01000000:3.0:1790391309.907649:0:11680:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790391309.907655:0:11680:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790391309.907660:0:11680:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790391309.912205:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1790391309.912533:0:11680:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1790391309.920047:0:11680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1790391309.920316:0:11680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1790391309.920383:0:11680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1790391309.920405:0:11680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790391309.920426:0:11680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920445:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920455:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a7de expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920462:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920472:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920493:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920501:0:11680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920541:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920557:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 12 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.920573:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787328:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391309.920726:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920745:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 12 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.920754:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787456:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391309.920785:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920793:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 18 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.920801:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787584:0@lo:104: 00000100:00100000:0.0:1790391309.920835:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391309.920883:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a7de expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920891:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a7de expref: 18 pid: 5830 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.920900:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787712:0@lo:104: 00000100:00100000:0.0:1790391309.920917:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391309.920949:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.920957:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 18 pid: 5829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.920965:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787840:0@lo:104: 00000100:00100000:0.0:1790391309.920990:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391309.920998:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391309.921097:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790391309.921110:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130787584 00000100:00100000:0.0:1790391309.921116:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130787584 00000100:00100000:0.0:1790391309.921160:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130787712 00000100:00100000:0.0:1790391309.921163:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130787712 00000100:00100000:0.0:1790391309.921173:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130787840 00000100:00100000:0.0:1790391309.921175:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130787840 00000100:00100000:0.0:1790391309.921186:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391309.921193:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:11680:x1877361130787584:12345-0@lo:104: 00010000:00010000:0.0:1790391309.921396:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921614:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391309.921621:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+5:11680:x1877361130787584:12345-0@lo:104: Request processed in 428us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391309.921638:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391309.921661:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391309.921668:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:11680:x1877361130787712:12345-0@lo:104: 00010000:00010000:0.0:1790391309.921678:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921712:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391309.921718:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+4:11680:x1877361130787712:12345-0@lo:104: Request processed in 51us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391309.921723:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391309.921745:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391309.921751:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d9a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:11680:x1877361130787840:12345-0@lo:104: 00010000:00010000:0.0:1790391309.921758:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921781:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790391309.921785:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d9a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c86877e-0672-4feb-acd6-39a38006ba27+3:11680:x1877361130787840:12345-0@lo:104: Request processed in 35us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391309.921791:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1790391309.921820:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790391309.921826:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921834:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391309.921838:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921856:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391309.921864:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391309.921870:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391309.921900:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921907:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391309.921928:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921936:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e30000/0x35e94fc15449a7ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921950:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391309.921953:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921958:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391309.921961:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.921968:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391309.921974:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391309.921984:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391309.921996:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922001:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391309.922007:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922039:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962400031400/0x35e94fc15449a7de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7e5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922050:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391309.922053:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922058:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391309.922061:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922068:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391309.922075:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391309.922090:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391309.922102:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922108:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391309.922137:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922145:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31e00/0x35e94fc15449a7d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449a7d7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922158:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391309.922160:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391309.922162:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391309.922182:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130787968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391309.922224:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391309.922256:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391309.922261:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130788096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391309.922280:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391309.922307:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130788224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391309.922335:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391309.922365:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130787968 00000100:00100000:0.0:1790391309.922371:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130787968 00010000:00010000:0.0:1790391309.922397:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 19 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.922414:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788096 00000100:00100000:0.0:1790391309.922417:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788096 00010000:00010000:0.0:1790391309.922427:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a7de expref: 20 pid: 5830 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.922436:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788224 00000100:00100000:0.0:1790391309.922439:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788224 00010000:00010000:0.0:1790391309.922447:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 21 pid: 5829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391309.922479:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391309.922487:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+21:3309:x1877361130787968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391309.922500:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391309.922504:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 21 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922514:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 21 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922530:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391309.922558:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+21:3309:x1877361130787968:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391309.922565:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391309.922579:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391309.922584:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+20:3309:x1877361130788096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391309.922591:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391309.922595:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a7de expref: 20 pid: 5830 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922603:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a7de expref: 20 pid: 5830 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922612:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391309.922631:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+20:3309:x1877361130788096:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391309.922637:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391309.922648:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391309.922660:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962408360c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130788224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391309.922668:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391309.922672:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 19 pid: 5829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922679:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 19 pid: 5829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391309.922688:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391309.922712:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962408360c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130788224:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391309.922717:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391309.922768:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130788224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391309.922792:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130788096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391309.922798:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130787968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391309.922973:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391309.926830:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400031a00/0x35e94fc15449a7f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a7ec expref: 18 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391309.926852:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787584:0@lo:104: 00000100:00100000:0.0:1790391309.927609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391309.927650:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391309.927722:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108735488 00000100:00100000:1.0:1790391309.927731:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108735488 00010000:00010000:1.0:1790391309.927792:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 13 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391309.927833:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108735360 00000100:00100000:1.0:1790391309.927837:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108735360 00010000:00010000:1.0:1790391309.927850:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 14 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391309.927864:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391309.927872:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+14:2363:x1877361108735488:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391309.927888:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391309.927894:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 14 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.927905:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 14 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.927936:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391309.927991:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+14:2363:x1877361108735488:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 119us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391309.927999:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391309.928039:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:1.0:1790391309.928047:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108735360:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391309.928055:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391309.928060:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 13 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928069:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 13 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928620:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928634:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928653:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928661:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928668:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928675:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928682:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217b400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391309.928687:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928695:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928705:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391309.928716:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391309.928757:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108735360:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 709us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391309.928776:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 34 00010000:00010000:2.0:1790391309.930573:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e30800/0x35e94fc15449a7e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a7de expref: 17 pid: 5830 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391309.930594:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787712:0@lo:104: 00010000:00010000:2.0:1790391309.930608:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2000/0x35e94fc15449a7d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449a7d0 expref: 16 pid: 5829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391309.930618:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787840:0@lo:104: 00010000:00010000:2.0:1790391309.930633:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400031600/0x35e94fc15449a801 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc6e expref: 12 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391309.930643:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787328:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391309.930675:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e31c00/0x35e94fc15449a7fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc67 expref: 11 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391309.930684:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1877361130787456:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391309.930721:0:11680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391309.930832:0:11680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391309.930840:0:11680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391309.930846:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96244217b400/0x35e94fc15449a935 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391310.681482:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391311.705254:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790391311.769249:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391311.770294:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96243f8f8000 from 7 10000000:01000000:0.0:1790391311.770300:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391311.770347:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.770359:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.770370:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391311.770422:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.770490:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.770605:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391311.770882:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788352 00000100:00100000:2.0:1790391311.770891:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788352 00000100:00100000:2.0:1790391311.771058:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790391311.771069:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+16:5833:x1877361130788352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391311.771083:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391311.771111:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412f11200/0x35e94fc15449a943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a93c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391311.771149:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412f11200/0x35e94fc15449a943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a93c expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391311.771161:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412f11200/0x35e94fc15449a943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a93c expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391311.771184:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11200, rc 0) 00000100:00100000:2.0:1790391311.771241:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130788352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391311.771248:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790391311.775804:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391311.775880:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.775892:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391311.775973:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.776477:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391311.776516:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788480 00000100:00100000:0.0:1790391311.776517:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391311.776524:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788480 00000100:00100000:2.0:1790391311.776577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790391311.776587:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130788480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391311.776847:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130788480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391311.776855:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790391311.776906:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.776937:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.776976:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.776992:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391311.777007:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788608 00000100:00100000:2.0:1790391311.777011:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788608 00000100:00100000:2.0:1790391311.777081:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790391311.777088:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130788608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391311.777271:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130788608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391311.777279:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790391311.778710:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391311.780784:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11695:1877361130788736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391311.780861:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391311.780898:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391311.780906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788736 00000100:00100000:2.0:1790391311.780913:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788736 00000100:00100000:2.0:1790391311.780960:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790391311.780969:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:11695:x1877361130788736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391311.783444:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:11695:x1877361130788736:12345-0@lo:502:llog_process_th.0 Request processed in 2466us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391311.783458:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790391311.783513:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11695:1877361130788736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391311.783546:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391311.783556:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391311.783558:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391311.783564:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96243f8f8000 00000020:00000080:3.0:1790391311.783567:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790391311.783675:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11695:1877361130788864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391311.783732:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391311.783776:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.786202:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788864 00000100:00100000:0.0:1790391311.786216:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788864 00000100:00100000:0.0:1790391311.786280:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790391311.786291:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:11695:x1877361130788864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.786548:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+17:11695:x1877361130788864:12345-0@lo:502:llog_process_th.0 Request processed in 258us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.786565:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790391311.786753:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11695:1877361130788864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391311.786788:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391311.786796:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391311.786798:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790391311.786802:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790391311.787303:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790391311.787323:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391311.787333:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.787344:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391311.787355:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391311.787357:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962439f98800 from 7 10000000:01000000:0.0:1790391311.787360:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391311.787389:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.787397:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.787406:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391311.787426:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.787467:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.787541:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391311.787582:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130788992 00000100:00100000:3.0:1790391311.787589:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130788992 00000100:00100000:3.0:1790391311.787666:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790391311.787674:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+17:5833:x1877361130788992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391311.787686:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391311.787699:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2a00/0x35e94fc15449a951 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a94a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391311.787720:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2a00/0x35e94fc15449a951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a94a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391311.787808:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2a00/0x35e94fc15449a951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a94a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391311.787816:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2a00, rc 0) 00000100:00100000:3.0:1790391311.787854:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130788992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391311.787860:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790391311.787913:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130788992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391311.787927:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.787936:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391311.787988:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.788040:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.788070:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391311.788548:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130789120 00000100:00100000:3.0:1790391311.788555:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130789120 00000100:00100000:3.0:1790391311.788633:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790391311.788641:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130789120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391311.788965:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130789120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391311.788973:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790391311.789059:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.789094:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.789153:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.789170:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.789182:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130789248 00000100:00100000:0.0:1790391311.789187:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130789248 00000100:00100000:0.0:1790391311.789207:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790391311.789213:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130789248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.789357:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130789248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.789363:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790391311.789398:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.789556:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11697:1877361130789376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.789587:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.789604:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130789376 00000100:00100000:0.0:1790391311.789607:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130789376 00000100:00100000:0.0:1790391311.789622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790391311.789628:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:11697:x1877361130789376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.789762:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:11697:x1877361130789376:12345-0@lo:502:llog_process_th.0 Request processed in 132us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.789777:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790391311.789811:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.789823:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11697:1877361130789376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391311.790116:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391311.790182:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391311.790186:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391311.790192:0:11697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962439f98800 00000020:00000080:0.0:1790391311.790195:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391311.790670:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11697:1877361130789504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.790889:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.790924:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130789504 00000100:00100000:0.0:1790391311.790931:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130789504 00000100:00100000:0.0:1790391311.790959:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790391311.790965:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:11697:x1877361130789504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391311.791140:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.791322:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+18:11697:x1877361130789504:12345-0@lo:502:llog_process_th.0 Request processed in 355us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.791330:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1790391311.791577:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11697:1877361130789504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391311.791604:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391311.791611:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391311.791614:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790391311.791619:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790391311.791710:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790391311.791812:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391311.791823:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.791835:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391311.791844:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391311.791847:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9624081bf000 from 7 10000000:01000000:0.0:1790391311.791857:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391311.791885:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.791892:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.791901:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391311.791917:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.791953:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.791983:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391311.792218:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130789632 00000100:00100000:1.0:1790391311.792224:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130789632 00000100:00100000:1.0:1790391311.792351:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1790391311.792360:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+18:5833:x1877361130789632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391311.792371:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391311.792384:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e31800/0x35e94fc15449a95f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449a958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391311.792407:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e31800/0x35e94fc15449a95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449a958 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391311.792416:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e31800/0x35e94fc15449a95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449a958 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391311.792424:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31800, rc 0) 00000100:00100000:1.0:1790391311.792470:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240e812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130789632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391311.792476:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790391311.792537:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391311.792551:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391311.792560:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391311.792607:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391311.792634:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391311.792700:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.792736:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130789760 00000100:00100000:0.0:1790391311.792740:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130789760 00000100:00100000:0.0:1790391311.792760:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790391311.792766:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130789760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.792987:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130789760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.792994:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790391311.793266:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.793299:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.793342:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.793362:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.793374:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130789888 00000100:00100000:0.0:1790391311.793377:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130789888 00000100:00100000:0.0:1790391311.793396:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790391311.793402:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130789888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.793536:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:5833:x1877361130789888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.793543:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790391311.793579:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c86877e-0672-4feb-acd6-39a38006ba27:5833:1877361130789888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.793748:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11698:1877361130790016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.793780:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.793797:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790016 00000100:00100000:0.0:1790391311.793801:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790016 00000100:00100000:0.0:1790391311.793817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790391311.793823:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:11698:x1877361130790016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.793939:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:11698:x1877361130790016:12345-0@lo:502:llog_process_th.0 Request processed in 115us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.793945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790391311.793971:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a6a0900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.793982:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11698:1877361130790016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391311.794003:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391311.794011:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391311.794033:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391311.794040:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9624081bf000 00000020:00000080:0.0:1790391311.794043:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391311.794539:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11698:1877361130790144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.794577:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.794599:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790144 00000100:00100000:0.0:1790391311.794603:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790144 00000100:00100000:0.0:1790391311.794630:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790391311.794644:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:11698:x1877361130790144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391311.794779:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:11698:x1877361130790144:12345-0@lo:502:llog_process_th.0 Request processed in 136us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.794786:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790391311.794814:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff962406a46240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391311.794827:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c86877e-0672-4feb-acd6-39a38006ba27:11698:1877361130790144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391311.794845:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391311.794849:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391311.794851:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790391311.794854:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790391311.794907:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790391311.794923:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391311.794932:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.794942:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391311.808462:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790391311.883159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391311.883463:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108735616 00000100:00100000:0.0:1790391311.883474:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108735616 00000100:00100000:0.0:1790391311.883539:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 265 00000100:00100000:0.0:1790391311.883551:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+11:5605:x1877361108735616:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391311.883569:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391311.883588:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031600/0x35e94fc15449a966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcbb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.883617:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031600/0x35e94fc15449a966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcbb expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.883641:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031600/0x35e94fc15449a966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcbb expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391311.883651:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031600, rc 0) 00000100:00100000:0.0:1790391311.883718:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108735616:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 169us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.883725:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 265 00000100:00100000:1.0:1790391311.888463:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391311.888546:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108735744 00000100:00100000:0.0:1790391311.888557:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108735744 00000100:00100000:0.0:1790391311.888609:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 266 00000100:00100000:0.0:1790391311.888618:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108735744:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.888897:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108735744:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 278us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.888905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 266 00000100:00100000:2.0:1790391311.890978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391311.891496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108735872 00000100:00100000:3.0:1790391311.891507:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108735872 00000100:00100000:3.0:1790391311.891614:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 267 00000100:00100000:3.0:1790391311.891624:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108735872:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391311.892595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108735872:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 734us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391311.892609:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 267 00000100:00100000:2.0:1790391311.897713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391311.897825:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736000 00000100:00100000:1.0:1790391311.897847:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736000 00000100:00100000:1.0:1790391311.897895:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 268 00000100:00100000:1.0:1790391311.897904:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+12:9982:x1877361108736000:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391311.898172:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+12:9982:x1877361108736000:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 267us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391311.898180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 268 00000100:00100000:2.0:1790391311.905772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391311.905895:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736128 00000100:00100000:0.0:1790391311.905906:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736128 00000100:00100000:0.0:1790391311.905968:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 269 00000100:00100000:0.0:1790391311.905979:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:9982:x1877361108736128:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391311.906283:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+12:9982:x1877361108736128:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 305us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.906292:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 269 00000100:00100000:0.0:1790391311.910385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391311.910575:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736256 00000100:00100000:3.0:1790391311.910586:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736256 00000100:00100000:3.0:1790391311.910637:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 270 00000100:00100000:3.0:1790391311.910647:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:5605:x1877361108736256:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391311.910662:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391311.910703:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2c00/0x35e94fc15449a96d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcc2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391311.910731:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2c00/0x35e94fc15449a96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcc2 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391311.910742:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2c00/0x35e94fc15449a96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcc2 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391311.910752:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2c00, rc 0) 00000100:00100000:3.0:1790391311.910804:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108736256:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 159us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391311.910811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 270 00000100:00100000:3.0:1790391311.925140:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391311.925534:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736384 00000100:00100000:2.0:1790391311.925544:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736384 00000100:00100000:2.0:1790391311.925647:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 271 00000100:00100000:2.0:1790391311.925658:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108736384:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391311.925952:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108736384:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 295us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391311.925959:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 271 00000100:00100000:1.0:1790391311.928234:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391311.928361:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736512 00000100:00100000:0.0:1790391311.928437:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736512 00000100:00100000:0.0:1790391311.928492:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 272 00000100:00100000:0.0:1790391311.928513:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108736512:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391311.928736:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:5605:x1877361108736512:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 224us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.928745:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 272 00000100:00100000:0.0:1790391311.934913:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391311.935230:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736640 00000100:00100000:2.0:1790391311.935240:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736640 00000100:00100000:2.0:1790391311.935299:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 273 00000100:00100000:2.0:1790391311.935309:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:9985:x1877361108736640:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391311.935546:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:9985:x1877361108736640:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 237us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391311.935554:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 273 00000100:00100000:2.0:1790391311.955515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391311.955614:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736768 00000100:00100000:3.0:1790391311.955623:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736768 00000100:00100000:3.0:1790391311.955797:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 274 00000100:00100000:3.0:1790391311.955810:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:9985:x1877361108736768:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391311.956088:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:9985:x1877361108736768:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 281us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391311.956108:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 274 00000100:00100000:0.0:1790391312.281513:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130790272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391312.281612:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391312.287066:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130790400:0@lo:400:kworker.0 00000100:00100000:1.0:1790391312.287506:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391312.287566:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130790912:0@lo:400:kworker.0 00000100:00100000:1.0:1790391312.287597:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391312.287628:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391312.287634:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130790528:0@lo:400:kworker.0 00000100:00100000:1.0:1790391312.287656:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391312.287695:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790400 00000100:00100000:1.0:1790391312.287702:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790400 00000100:00100000:1.0:1790391312.287754:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391312.287763:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130790400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391312.287830:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130790400:12345-0@lo:400:kworker.0 Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391312.287838:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391312.287888:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130790400:0@lo:400:kworker.0 00000100:00100000:1.0:1790391312.287918:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790912 00000100:00100000:1.0:1790391312.287922:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790912 00000100:00100000:1.0:1790391312.287956:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790528 00000100:00100000:1.0:1790391312.287959:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790528 00000100:00100000:3.0:1790391312.288040:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790391312.288051:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130790912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391312.288105:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130790912:12345-0@lo:400:kworker.0 Request processed in 57us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391312.288112:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790391312.288390:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130790656:0@lo:400:kworker.0 00000100:00100000:3.0:1790391312.288441:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391312.288467:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391312.288474:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130790784:0@lo:400:kworker.0 00000100:00100000:3.0:1790391312.288498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391312.288525:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790656 00000100:00100000:3.0:1790391312.288530:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790656 00000100:00100000:3.0:1790391312.288561:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790784 00000100:00100000:3.0:1790391312.288564:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790784 00000100:00100000:3.0:1790391312.288583:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790391312.288590:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130790656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391312.288628:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130790656:12345-0@lo:400:kworker.0 Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391312.288636:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790391312.288648:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790391312.288654:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130790784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391312.288679:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130790784:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391312.288685:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790391312.288722:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130790784:0@lo:400:kworker.0 00000100:00100000:3.0:1790391312.288732:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130790656:0@lo:400:kworker.0 00000100:00080000:3.0:1790391312.288772:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391312.288777:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790391312.288804:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f55f80 x1877361130790912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391312.288815:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130790912:0@lo:400:kworker.0 00000100:00100000:1.0:1790391312.289565:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790391312.289574:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877361130790528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391312.289623:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877361130790528:12345-0@lo:400:kworker.0 Request processed in 50us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391312.289630:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1790391312.291087:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391312.291232:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130790528:0@lo:400:kworker.0 00000100:00100000:0.0:1790391312.299395:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130790272 00000100:00100000:0.0:1790391312.299412:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130790272 00000100:00100000:0.0:1790391312.299473:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790391312.299483:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130790272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391312.299526:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391312.299603:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130790272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (17991us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391312.299609:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1790391312.299687:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439989c00 x1877361130790272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391312.299711:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130790272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391312.657732:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391312.657792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391312.657913:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108736896 00000100:00100000:1.0:1790391312.657924:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108736896 00000100:00100000:1.0:1790391312.657990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 275 00000100:00100000:1.0:1790391312.658002:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108736896:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391312.658116:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108736896:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 116us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391312.658124:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 275 00000100:00100000:0.0:1790391312.658490:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391312.658526:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391312.658597:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737024 00000100:00100000:2.0:1790391312.658602:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737024 00000100:00100000:2.0:1790391312.658651:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737280 00000100:00100000:2.0:1790391312.658655:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737280 00000100:00100000:2.0:1790391312.658677:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 107 00000100:00100000:2.0:1790391312.658686:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108737024:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391312.658729:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108737024:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 44us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391312.658754:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 107 00000100:00100000:2.0:1790391312.658770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00100000:2.0:1790391312.658776:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108737280:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391312.658815:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108737280:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391312.658822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00080000:0.0:1790391312.659062:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391312.660243:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737152 00000100:00100000:3.0:1790391312.660254:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737152 00000100:00100000:3.0:1790391312.660356:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:3.0:1790391312.660366:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108737152:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391312.660428:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108737152:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 64us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391312.660435:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00080000:0.0:1790391312.660668:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391312.729347:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391312.857695:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391313.754806:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790391313.999439:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1790391314.331147:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391314.331173:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130791040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391314.331242:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391314.331422:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791040 00000100:00100000:0.0:1790391314.331431:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791040 00000100:00100000:0.0:1790391314.331503:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391314.331514:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130791040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391314.331550:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391314.331613:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130791040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.331620:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391314.331834:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1790391314.331840:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96242d860a80, transno 4294967300 00000100:00100000:0.0:1790391314.331865:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130791040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790391314.332509:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391314.779069:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391315.801651:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391316.826101:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391317.401528:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391317.401555:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130791168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391317.401623:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391317.401797:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130791424:0@lo:400:kworker.0 00000100:00100000:0.0:1790391317.401827:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391317.401850:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391317.401857:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130791552:0@lo:400:kworker.0 00000100:00100000:0.0:1790391317.401892:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391317.401924:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791424 00000100:00100000:0.0:1790391317.401931:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791424 00000100:00100000:0.0:1790391317.401973:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790391317.401981:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130791424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391317.402081:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130791424:12345-0@lo:400:kworker.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391317.402088:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790391317.402110:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791552 00000100:00100000:0.0:1790391317.402114:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791552 00000100:00100000:0.0:1790391317.402171:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790391317.402178:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130791552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391317.402428:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130791552:12345-0@lo:400:kworker.0 Request processed in 250us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391317.402435:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1790391317.402452:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391317.402477:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130791552:0@lo:400:kworker.0 00000100:00100000:0.0:1790391317.402488:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130791424:0@lo:400:kworker.0 00000100:00100000:1.0:1790391317.402558:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130791296:0@lo:400:kworker.0 00000100:00100000:1.0:1790391317.402588:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391317.402621:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130791808:0@lo:400:kworker.0 00000100:00100000:1.0:1790391317.402642:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391317.402657:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391317.402662:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130791680:0@lo:400:kworker.0 00000100:00100000:1.0:1790391317.402682:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391317.402744:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791296 00000100:00100000:0.0:1790391317.402748:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791296 00000100:00100000:0.0:1790391317.402781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790391317.402788:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130791296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391317.402821:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130791296:12345-0@lo:400:kworker.0 Request processed in 34us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391317.402827:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1790391317.402915:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130791296:0@lo:400:kworker.0 00000100:00100000:2.0:1790391317.403483:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791168 00000100:00100000:2.0:1790391317.403489:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791168 00000100:00100000:2.0:1790391317.403532:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391317.403540:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130791168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391317.403569:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391317.403617:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130791168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391317.403624:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391317.403642:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791808 00000100:00100000:2.0:1790391317.403645:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791808 00000100:00100000:2.0:1790391317.403667:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791680 00000100:00100000:2.0:1790391317.403669:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791680 00000100:00100000:2.0:1790391317.403688:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790391317.403694:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130791808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391317.403725:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130791808:12345-0@lo:400:kworker.0 Request processed in 31us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391317.403731:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790391317.403742:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790391317.403747:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130791680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391317.403785:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130791680:12345-0@lo:400:kworker.0 Request processed in 38us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391317.403791:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790391317.403839:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130791680:0@lo:400:kworker.0 00000100:00100000:2.0:1790391317.403849:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130791808:0@lo:400:kworker.0 00010000:00080000:2.0:1790391317.403862:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439f04380 x1877361130791168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391317.403877:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130791168:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790391317.404329:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391317.404335:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391317.771441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391317.771482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391317.771525:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391317.771552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391317.771584:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737664 00000100:00100000:3.0:1790391317.771593:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737664 00000100:00100000:3.0:1790391317.771667:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:3.0:1790391317.771678:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108737664:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391317.771749:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108737664:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391317.771756:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00080000:0.0:1790391317.771934:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391317.772051:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737536 00000100:00100000:2.0:1790391317.772056:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737536 00000100:00100000:2.0:1790391317.772097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737792 00000100:00100000:2.0:1790391317.772100:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737792 00000100:00100000:2.0:1790391317.772124:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00100000:2.0:1790391317.772132:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108737536:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391317.772166:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108737536:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 35us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391317.772173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00100000:2.0:1790391317.772185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 113 00000100:00100000:2.0:1790391317.772191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108737792:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391317.772227:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108737792:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 36us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391317.772233:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 113 00000100:00100000:2.0:1790391317.772251:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737408 00000100:00100000:2.0:1790391317.772254:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737408 00000100:00100000:2.0:1790391317.772290:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 277 00000100:00100000:2.0:1790391317.772296:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108737408:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391317.772322:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108737408:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 27us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391317.772329:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 277 00000100:00080000:0.0:1790391317.772604:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790391317.849497:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391318.873253:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391319.449366:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391319.449394:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130791936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391319.449460:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391319.449500:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130791936 00000100:00100000:2.0:1790391319.449508:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130791936 00000100:00100000:2.0:1790391319.449564:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391319.449585:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130791936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391319.449623:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391319.449679:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130791936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391319.449686:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790391319.449839:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130791936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790391319.449898:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790391319.897330:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391320.922079:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391321.945263:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391322.073801:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790391322.521686:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130792064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391322.521757:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391322.521857:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792064 00000100:00100000:1.0:1790391322.521865:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792064 00000100:00100000:1.0:1790391322.521932:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790391322.521943:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130792064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391322.521975:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790391322.522222:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391322.523321:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130792320:0@lo:400:kworker.0 00000100:00100000:3.0:1790391322.523490:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130792192:0@lo:400:kworker.0 00000100:00100000:1.0:1790391322.523839:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130792064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1896us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391322.523850:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790391322.523911:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130792448:0@lo:400:kworker.0 00010000:00080000:0.0:1790391322.524639:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03c000 x1877361130792064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391322.524666:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130792064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391322.524693:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130792576:0@lo:400:kworker.0 00000100:00100000:0.0:1790391322.524753:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391322.524829:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792576 00000100:00100000:0.0:1790391322.524836:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792576 00000100:00100000:0.0:1790391322.524887:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790391322.524895:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130792576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391322.525221:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130792576:12345-0@lo:400:kworker.0 Request processed in 326us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.525228:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1790391322.525249:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391322.525406:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130792576:0@lo:400:kworker.0 00000100:00100000:3.0:1790391322.527405:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391322.527469:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130792704:0@lo:400:kworker.0 00000100:00100000:3.0:1790391322.527509:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391322.527843:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792192 00000100:00100000:0.0:1790391322.527853:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792192 00000100:00100000:0.0:1790391322.528068:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790391322.528079:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130792192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391322.528142:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130792192:12345-0@lo:400:kworker.0 Request processed in 65us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.528149:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790391322.528743:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792704 00000100:00100000:0.0:1790391322.528750:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792704 00000100:00100000:0.0:1790391322.528794:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790391322.528801:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130792704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391322.528842:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130792704:12345-0@lo:400:kworker.0 Request processed in 41us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.528850:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1790391322.528869:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391322.529175:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391322.530269:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792320 00000100:00100000:0.0:1790391322.530279:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792320 00000100:00100000:0.0:1790391322.530534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790391322.530544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130792320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391322.530728:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130792320:12345-0@lo:400:kworker.0 Request processed in 186us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.530736:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790391322.531000:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130792320:0@lo:400:kworker.0 00000100:00100000:3.0:1790391322.531050:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130792192:0@lo:400:kworker.0 00000100:00100000:3.0:1790391322.531064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130792704:0@lo:400:kworker.0 00000100:00100000:1.0:1790391322.531165:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391322.533679:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792448 00000100:00100000:3.0:1790391322.533696:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792448 00000100:00100000:3.0:1790391322.533782:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790391322.533792:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130792448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391322.533873:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130792448:12345-0@lo:400:kworker.0 Request processed in 82us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391322.533881:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790391322.534045:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130792448:0@lo:400:kworker.0 00000100:00080000:1.0:1790391322.534071:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391322.895163:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391322.895205:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391322.895234:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391322.895278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391322.895470:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108737920 00000100:00100000:0.0:1790391322.895481:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108737920 00000100:00100000:0.0:1790391322.895538:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 279 00000100:00100000:0.0:1790391322.895550:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108737920:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391322.895619:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108737920:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 71us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.895627:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 279 00000100:00100000:0.0:1790391322.895752:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738048 00000100:00100000:0.0:1790391322.895756:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738048 00000100:00100000:0.0:1790391322.895800:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738304 00000100:00100000:0.0:1790391322.895803:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738304 00000100:00100000:0.0:1790391322.895826:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:0.0:1790391322.895833:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108738048:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391322.895866:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108738048:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.895872:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:0.0:1790391322.895885:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:0.0:1790391322.895892:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108738304:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391322.895930:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108738304:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.895937:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00080000:1.0:1790391322.896030:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391322.896283:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738176 00000100:00100000:3.0:1790391322.896289:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738176 00000100:00080000:1.0:1790391322.896454:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391322.896526:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:3.0:1790391322.896536:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108738176:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391322.896582:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108738176:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 48us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391322.896589:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 54 00010000:00010000:0.0:1790391322.970767:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391323.993377:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391324.570285:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130792832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391324.570363:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391324.571981:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792832 00000100:00100000:2.0:1790391324.571994:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792832 00000100:00100000:2.0:1790391324.572108:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391324.572121:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130792832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391324.572159:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391324.572254:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130792832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391324.572261:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790391324.572311:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130792832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391324.572394:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391325.019165:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391326.044165:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391327.065243:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391327.641680:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130792960:0@lo:400:kworker.0 00000100:00100000:1.0:1790391327.641765:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391327.641833:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130793472:0@lo:400:kworker.0 00000100:00100000:1.0:1790391327.642391:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391327.642422:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790391327.642428:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130793088:0@lo:400:kworker.0 00000100:00100000:1.0:1790391327.642466:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391327.642483:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130793600:0@lo:400:kworker.0 00000100:00100000:0.0:1790391327.642629:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793472 00000100:00100000:0.0:1790391327.642638:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793472 00000100:00100000:0.0:1790391327.642690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793088 00000100:00100000:0.0:1790391327.642693:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793088 00000100:00100000:0.0:1790391327.642714:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790391327.642723:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130793472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391327.642822:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130792960 00000100:00100000:2.0:1790391327.642826:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130792960 00000100:00100000:2.0:1790391327.642879:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790391327.642885:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130792960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391327.643946:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130793216:0@lo:400:kworker.0 00000100:00100000:0.0:1790391327.658550:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130793472:12345-0@lo:400:kworker.0 Request processed in 15818us (16150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391327.658565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790391327.658603:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790391327.658615:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130793088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391327.658669:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130793088:12345-0@lo:400:kworker.0 Request processed in 58us (16203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391327.658674:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1790391327.658741:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391327.658816:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130793344:0@lo:400:kworker.0 00000100:00100000:0.0:1790391327.658866:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391327.658903:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391327.658909:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130793728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391327.658933:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391327.658976:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793344 00000100:00100000:0.0:1790391327.658983:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793344 00000100:00100000:0.0:1790391327.659047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790391327.659054:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130793344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391327.659089:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130793344:12345-0@lo:400:kworker.0 Request processed in 36us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391327.659109:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1790391327.659124:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391327.659149:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130793344:0@lo:400:kworker.0 00000100:00100000:1.0:1790391327.664111:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391327.664385:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130793472:0@lo:400:kworker.0 00000100:00100000:1.0:1790391327.664418:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130793088:0@lo:400:kworker.0 00000100:00100000:0.0:1790391327.664614:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793600 00000100:00100000:0.0:1790391327.664622:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793600 00000100:00100000:0.0:1790391327.664693:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391327.664702:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130793600:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790391327.664822:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391327.664855:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793728 00000100:00100000:1.0:1790391327.664860:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793728 00000100:00100000:1.0:1790391327.664895:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790391327.664902:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130793728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391327.664929:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391327.664969:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130793728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (6033us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391327.664975:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1790391327.665048:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03e680 x1877361130793728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391327.665067:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130793728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391327.668962:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130793600:12345-0@lo:400:kworker.0 Request processed in 4249us (4916us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391327.668981:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790391327.670080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391327.670464:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130792960:12345-0@lo:400:kworker.0 Request processed in 27575us (28696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391327.670478:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790391327.670698:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793216 00000100:00100000:0.0:1790391327.670708:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793216 00000100:00100000:0.0:1790391327.670779:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391327.670802:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130793216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391327.670883:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130793216:12345-0@lo:400:kworker.0 Request processed in 96us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391327.670890:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1790391327.671142:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391327.672075:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130793216:0@lo:400:kworker.0 00010000:00080000:1.0:1790391327.673089:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f685f80 x1877361130793600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391327.673106:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130793600:0@lo:400:kworker.0 00000100:00100000:1.0:1790391327.673125:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130792960:0@lo:400:kworker.0 00000100:00100000:0.0:1790391328.018585:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391328.018714:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391328.018933:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738432 00000100:00100000:1.0:1790391328.018946:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738432 00000100:00100000:1.0:1790391328.019055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 281 00000100:00100000:1.0:1790391328.019068:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108738432:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391328.019167:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108738432:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 102us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391328.019176:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 281 00000100:00100000:2.0:1790391328.019677:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738560 00000100:00100000:2.0:1790391328.019684:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738560 00000100:00100000:2.0:1790391328.019787:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:2.0:1790391328.019797:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108738560:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391328.019899:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108738560:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 104us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391328.019907:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00080000:1.0:1790391328.019994:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391328.029667:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391328.029725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391328.029885:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738816 00000100:00100000:2.0:1790391328.029899:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738816 00000100:00100000:2.0:1790391328.030003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:2.0:1790391328.030055:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108738816:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391328.030172:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108738816:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 157us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391328.030180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:1.0:1790391328.030739:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738688 00000100:00100000:1.0:1790391328.030748:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738688 00000100:00100000:1.0:1790391328.030803:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:1.0:1790391328.030814:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2362:x1877361108738688:12345-192.168.201.8@tcp:9:kworker.0 00000020:00000080:1.0:1790391328.030850:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a8a9 00000100:00080000:1.0:1790391328.030862:0:6694:0:(import.c:65:import_set_state_nolock()) ffff96243a18f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391328.030915:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1790391328.031268:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+2:2362:x1877361108738688:12345-192.168.201.8@tcp:9:kworker.0 Request processed in 456us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391328.031277:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00010000:00010000:1.0:1790391328.031297:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391328.032938:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391328.032949:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391328.092202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391329.113366:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790391329.247495:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:2.0:1790391329.247509:0:6726:0:(genops.c:885:class_export_put()) final put ffff96243a189800/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:0.0:1790391329.248119:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a189800/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f for lustre-OST0000 00000020:00000080:0.0:1790391329.248289:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243a18f800 for lustre-OST0000 00000100:00100000:2.0:1790391329.692328:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391329.692781:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130793856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391329.692889:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391329.693111:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793856 00000100:00100000:3.0:1790391329.693122:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793856 00000100:00100000:3.0:1790391329.693287:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790391329.693300:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130793856:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391329.693320:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790391329.693746:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391329.693889:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130793856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 591us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391329.693899:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391329.705642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130793856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391330.139418:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391331.164975:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391332.185468:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391332.314754:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391332.762127:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130793984:0@lo:400:kworker.0 00000100:00100000:3.0:1790391332.762337:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391332.763215:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130794112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391332.763275:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391332.763609:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130794112 00000100:00100000:3.0:1790391332.763617:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130794112 00000100:00100000:2.0:1790391332.768065:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130793984 00000100:00100000:2.0:1790391332.768084:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130793984 00000100:00100000:2.0:1790391332.768165:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1790391332.768177:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130793984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391332.768276:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130793984:12345-0@lo:400:kworker.0 Request processed in 101us (5939us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391332.768284:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1790391332.770850:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391332.770913:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130793984:0@lo:400:kworker.0 00000100:00100000:3.0:1790391332.771001:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790391332.771031:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130794112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391332.771074:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391332.771149:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130794112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (7874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391332.771156:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1790391332.771194:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96242d03e680 x1877361130794112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391332.771225:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130794112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391332.771303:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130794240:0@lo:400:kworker.0 00000100:00100000:3.0:1790391332.771346:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391332.771384:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130794240 00000100:00100000:3.0:1790391332.771390:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130794240 00000100:00100000:3.0:1790391332.771423:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790391332.771430:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130794240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391332.771466:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130794240:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391332.771473:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790391332.771500:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130794240:0@lo:400:kworker.0 00000100:00100000:3.0:1790391332.771527:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391332.771533:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130794368:0@lo:400:kworker.0 00000100:00100000:3.0:1790391332.771558:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391332.771582:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130794368 00000100:00100000:3.0:1790391332.771586:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130794368 00000100:00100000:3.0:1790391332.771618:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790391332.771624:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130794368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391332.771655:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130794368:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391332.771660:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391332.782303:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391332.782326:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130794496:0@lo:400:kworker.0 00000100:00100000:2.0:1790391332.782554:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391332.782664:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130794624:0@lo:400:kworker.0 00000100:00100000:2.0:1790391332.782689:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391332.782872:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130794496 00000100:00100000:1.0:1790391332.782879:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130794496 00000100:00100000:1.0:1790391332.782935:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130794624 00000100:00100000:1.0:1790391332.782938:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130794624 00000100:00100000:1.0:1790391332.782965:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790391332.782974:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130794496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391332.783053:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130794496:12345-0@lo:400:kworker.0 Request processed in 79us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391332.783060:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790391332.783078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790391332.783084:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130794624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391332.783111:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130794624:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391332.783117:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790391332.783581:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130794624:0@lo:400:kworker.0 00000100:00100000:2.0:1790391332.783593:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130794496:0@lo:400:kworker.0 00000100:00080000:3.0:1790391332.786099:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391332.786110:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391332.786165:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130794368:0@lo:400:kworker.0 00000100:00100000:3.0:1790391333.144149:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391333.144207:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391333.144250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391333.144350:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108739072 00000100:00100000:2.0:1790391333.144361:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108739072 00000100:00100000:0.0:1790391333.144396:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108738944 00000100:00100000:0.0:1790391333.144407:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108738944 00000100:00100000:2.0:1790391333.144436:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108739200 00000100:00100000:2.0:1790391333.144442:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108739200 00000100:00100000:0.0:1790391333.144467:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 283 00000100:00100000:2.0:1790391333.144475:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:0.0:1790391333.144485:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108738944:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391333.144493:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108739072:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391333.144562:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108739072:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 78us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391333.144570:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:2.0:1790391333.144591:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 128 00000100:00100000:2.0:1790391333.144599:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108739200:12345-192.168.201.8@tcp:400:kworker.0 00000100:00080000:3.0:1790391333.144687:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391333.144958:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108738944:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 477us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391333.144966:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 283 00000100:00100000:2.0:1790391333.147836:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108739200:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 3221us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391333.147857:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 128 00010000:00010000:0.0:1790391333.209894:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391334.241429:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790391334.537052:0:11862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:55:32 (1790391332) 00000100:00100000:0.0:1790391334.809266:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130794752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391334.809374:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391334.809489:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130794752 00000100:00100000:0.0:1790391334.809500:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130794752 00000100:00100000:0.0:1790391334.809573:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391334.809585:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130794752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391334.809636:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391334.809694:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130794752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391334.809702:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1790391334.809741:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391334.809789:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130794752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391335.258050:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391336.281522:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391336.526938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391336.527258:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108739328 00000100:00100000:3.0:1790391336.527272:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108739328 00000100:00100000:3.0:1790391336.527378:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:3.0:1790391336.527392:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:10254:x1877361108739328:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391336.527421:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391336.527464:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a974 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcc9 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391336.527558:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a97b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391336.527577:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a97b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391336.527595:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a97b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391336.527645:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790391336.527650:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391336.527718:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a97b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391336.527749:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a974 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcc9 expref: 7 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391336.527773:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a97b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcc9 expref: 6 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790391336.527893:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790391336.529754:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391336.529759:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391336.529764:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3e00, rc 0) 00000100:00100000:3.0:1790391336.529957:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:10254:x1877361108739328:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 2562us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391336.529968:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:3.0:1790391336.537544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391336.540411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108739456 00000100:00100000:1.0:1790391336.540446:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108739456 00000100:00100000:1.0:1790391336.540559:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391336.540574:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:10255:x1877361108739456:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391336.540614:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391336.540651:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcd0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.540752:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.540772:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.540796:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.540834:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.540843:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.540850:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541348:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449a997 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541361:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449a997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541369:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449a997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391336.541411:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391336.541416:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391336.541445:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449a997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541458:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541467:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541475:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541492:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391336.541498:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541507:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541522:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373400) 00010000:00010000:1.0:1790391336.541526:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391336.541532:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541539:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541555:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541561:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541568:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541573:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391336.541576:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541583:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541611:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9624119e7700) 00010000:00010000:1.0:1790391336.541614:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391336.541617:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541623:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541666:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449a982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcd0 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541683:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449a997 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcd0 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391336.541702:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9624119e7600) 00010000:00010000:1.0:1790391336.541705:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391336.541708:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30800, rc 0) 00000100:00100000:1.0:1790391336.542576:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:10255:x1877361108739456:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 1998us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.542588:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391336.557725:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391336.559582:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108739712 00000100:00100000:2.0:1790391336.559606:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108739712 00000100:00100000:2.0:1790391336.559731:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:2.0:1790391336.559745:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:10255:x1877361108739712:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391336.559776:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391336.559817:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449a99e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcd7 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.559929:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.559952:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.559968:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.569131:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.569156:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.569171:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571173:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a9b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571195:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571206:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391336.571218:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790391336.571374:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571381:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571387:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571392:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391336.571396:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571403:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571413:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9624119e7600) 00010000:00010000:2.0:1790391336.571416:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391336.571420:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571438:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449a9a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571452:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571458:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571463:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571466:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391336.571469:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571474:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571481:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96240bf85600) 00010000:00010000:2.0:1790391336.571483:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391336.571486:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.571491:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449a9ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.577125:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449a99e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcd7 expref: 10 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.577178:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcd7 expref: 9 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391336.577187:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:2.0:1790391336.577190:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391336.577193:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11400, rc 0) 00000100:00100000:2.0:1790391336.577283:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10255:x1877361108739712:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 17540us (19574us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790391336.577294:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:2.0:1790391336.584893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391336.585337:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108739840 00000100:00100000:3.0:1790391336.585351:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108739840 00000100:00100000:3.0:1790391336.585472:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:3.0:1790391336.585486:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10255:x1877361108739840:12345-192.168.201.8@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790391336.586396:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10255:x1877361108739840:12345-192.168.201.8@tcp:59:lhsmtool_posix.0 Request processed in 905us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391336.586410:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00010000:00010000:3.0:1790391337.320374:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391337.435062:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790391337.881301:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130795008:0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.881399:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391337.881479:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130795520:0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.881509:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391337.881547:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391337.881553:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130795136:0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.881577:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391337.881615:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130795008 00000100:00100000:2.0:1790391337.881624:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130795008 00000100:00100000:2.0:1790391337.881699:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790391337.881715:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130795008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.881779:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130795008:12345-0@lo:400:kworker.0 Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391337.881787:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790391337.881825:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130795520 00000100:00100000:2.0:1790391337.881829:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130795520 00000100:00100000:2.0:1790391337.881865:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130795136 00000100:00100000:2.0:1790391337.881868:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130795136 00000100:00100000:2.0:1790391337.881893:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391337.881899:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130795520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.881932:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130795520:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391337.881939:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391337.881952:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391337.881958:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130795136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.881986:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130795136:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391337.881992:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391337.882065:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130795136:0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.882079:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130795008:0@lo:400:kworker.0 00010000:00080000:2.0:1790391337.882091:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96243f685f80 x1877361130795520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391337.882103:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130795520:0@lo:400:kworker.0 00000100:00100000:0.0:1790391337.882235:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130794880:0@lo:400:kworker.0 00000100:00100000:0.0:1790391337.882275:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391337.882309:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130795392:0@lo:400:kworker.0 00000100:00100000:0.0:1790391337.882330:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391337.882349:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391337.882354:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130795264:0@lo:400:kworker.0 00000100:00100000:0.0:1790391337.882375:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790391337.882411:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391337.882416:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391337.882439:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130795392 00000100:00100000:0.0:1790391337.882444:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130795392 00000100:00100000:0.0:1790391337.882474:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130795264 00000100:00100000:0.0:1790391337.882477:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130795264 00000100:00100000:0.0:1790391337.882497:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790391337.882504:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130795392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391337.882540:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130795392:12345-0@lo:400:kworker.0 Request processed in 36us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391337.882547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790391337.882560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790391337.882565:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130795264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391337.882590:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130795264:12345-0@lo:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391337.882596:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1790391337.882611:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391337.882628:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130795264:0@lo:400:kworker.0 00000100:00100000:0.0:1790391337.882647:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130795392:0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.882880:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130794880 00000100:00100000:2.0:1790391337.882885:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130794880 00000100:00100000:2.0:1790391337.882911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790391337.882918:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130794880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.882960:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130794880:12345-0@lo:400:kworker.0 Request processed in 42us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391337.882975:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790391337.883053:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130794880:0@lo:400:kworker.0 00000100:00100000:2.0:1790391337.883334:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130795648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391337.883369:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391337.883522:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130795648 00000100:00100000:0.0:1790391337.883528:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130795648 00000100:00100000:0.0:1790391337.883604:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790391337.883611:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130795648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391337.883650:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391337.883709:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130795648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391337.883716:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1790391337.883795:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439b75f80 x1877361130795648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391337.883816:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130795648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391338.251681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391338.251735:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108740096 00000100:00100000:2.0:1790391338.251742:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391338.251751:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108740096 00000100:00100000:2.0:1790391338.251783:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391338.251811:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108740224 00000100:00100000:2.0:1790391338.251815:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108740224 00000100:00100000:3.0:1790391338.251903:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108739968 00000100:00100000:3.0:1790391338.251908:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108739968 00000100:00100000:3.0:1790391338.251940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 285 00000100:00100000:1.0:1790391338.251940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 132 00000100:00100000:3.0:1790391338.251951:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108739968:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391338.251951:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2363:x1877361108740096:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391338.252067:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2363:x1877361108740096:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 117us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391338.252075:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 132 00000100:00100000:2.0:1790391338.256429:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00100000:2.0:1790391338.256462:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108740224:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391338.256805:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108739968:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 4852us (5057us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391338.256841:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 285 00000100:00100000:2.0:1790391338.262405:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108740224:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 5942us (10602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391338.262425:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00080000:2.0:1790391338.262476:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790391338.329162:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391338.794587:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391338.794706:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108740352 00000100:00100000:1.0:1790391338.794717:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108740352 00000100:00100000:1.0:1790391338.794769:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:1.0:1790391338.794780:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10298:x1877361108740352:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391338.794800:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391338.794821:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a9c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcde expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.794882:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.794896:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.794910:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795233:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795243:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795251:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795436:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795449:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795530:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795536:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391338.795541:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795549:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795562:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373400) 00010000:00010000:1.0:1790391338.795565:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391338.795570:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795577:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449a9c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795587:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795593:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795599:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795605:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391338.795612:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795619:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795627:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9624119e7700) 00010000:00010000:1.0:1790391338.795709:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391338.795714:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795720:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449a9cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795757:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a9c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcde expref: 10 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795768:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373400) 00010000:00010000:1.0:1790391338.795770:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391338.795774:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449a9c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcde expref: 10 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.795783:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31e00, rc 0) 00000100:00100000:1.0:1790391338.795910:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10298:x1877361108740352:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1130us (1328us total) trans 0 rc 301/301 00000100:00100000:1.0:1790391338.795932:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:1.0:1790391338.809420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391338.809574:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108740608 00000100:00100000:2.0:1790391338.809583:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108740608 00000100:00100000:2.0:1790391338.809646:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:2.0:1790391338.809667:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10298:x1877361108740608:12345-192.168.201.8@tcp:36:lfs.0 00010000:00010000:2.0:1790391338.809722:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391338.809745:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a97b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcc9 expref: 9 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.809760:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373400) 00010000:00010000:2.0:1790391338.809770:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391338.809965:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.809989:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.809997:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810006:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810011:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810035:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391338.810701:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790391338.810711:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810716:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810721:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810725:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391338.810728:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810732:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810747:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96240bf85700) 00010000:00010000:2.0:1790391338.810749:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391338.810752:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.810756:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449a9d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391338.810767:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000653b16d4 reply state 000000007174079b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391338.810772:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391338.810856:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:10298:x1877361108740608:12345-192.168.201.8@tcp:36:lfs.0 Request processed in 1201us (1441us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790391338.810862:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 37 00010000:00010000:3.0:1790391338.814675:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.814694:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.814701:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.814707:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391338.814713:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.814721:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.814738:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96240bf85b00) 00010000:00010000:3.0:1790391338.814742:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391338.814746:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.814753:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449a9dd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391338.883601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391338.885216:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108740736 00000100:00100000:3.0:1790391338.885228:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108740736 00000100:00100000:3.0:1790391338.885307:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:3.0:1790391338.885317:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10306:x1877361108740736:12345-192.168.201.8@tcp:101:lctl.0 00010000:00010000:3.0:1790391338.885339:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391338.885358:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a9e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fce5 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.885422:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a9eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.885433:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a9eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.885441:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a9eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391338.885472:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790391338.885476:0:11443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391338.885512:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a9eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.885531:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a9e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fce5 expref: 11 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.885545:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a9eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fce5 expref: 10 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.885551:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391338.885553:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391338.885555:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3e00, rc 0) 00000100:00100000:3.0:1790391338.885600:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:10306:x1877361108740736:12345-192.168.201.8@tcp:101:lctl.0 Request processed in 286us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391338.885610:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:1.0:1790391338.930237:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391338.930321:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108740864 00000100:00100000:3.0:1790391338.930331:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108740864 00000100:00100000:3.0:1790391338.930389:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1790391338.930397:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:10312:x1877361108740864:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:3.0:1790391338.930414:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391338.930429:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a9f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcec expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930490:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930505:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930514:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930526:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930531:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930534:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930609:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3c00/0x35e94fc15449aa07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930641:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3c00/0x35e94fc15449aa07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930648:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3c00/0x35e94fc15449aa07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391338.930688:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790391338.930692:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391338.930725:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3c00/0x35e94fc15449aa07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930735:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930739:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930743:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930747:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391338.930750:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930755:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930763:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391338.930765:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391338.930768:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930778:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449a9f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930789:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930792:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930796:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930799:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391338.930801:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930804:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930808:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff962411373600) 00010000:00010000:3.0:1790391338.930809:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391338.930811:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930814:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930836:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449a9f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcec expref: 12 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930844:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3c00/0x35e94fc15449aa07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcec expref: 11 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.930853:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:3.0:1790391338.930854:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790391338.930856:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3c00, rc 0) 00000100:00100000:3.0:1790391338.930905:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:10312:x1877361108740864:12345-192.168.201.8@tcp:101:bash.0 Request processed in 509us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391338.930912:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:2.0:1790391338.933438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391338.933521:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108741120 00000100:00100000:3.0:1790391338.933530:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108741120 00000100:00100000:3.0:1790391338.933596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1790391338.933604:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:10312:x1877361108741120:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:3.0:1790391338.933619:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391338.933644:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcf3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.933760:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.933772:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.933780:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.933840:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.933845:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.933864:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391338.934519:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1790391338.934759:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934768:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934773:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934797:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934802:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934807:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934810:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391338.934813:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934818:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934825:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:3.0:1790391338.934827:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391338.934836:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934841:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391338.934851:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef3e31e5 reply state 00000000e44ce10b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391338.934856:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790391338.934878:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934887:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.934891:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391338.934893:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391338.934894:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3600, rc 0) 00000100:00100000:3.0:1790391338.935009:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10312:x1877361108741120:12345-192.168.201.8@tcp:101:bash.0 Request processed in 1406us (1579us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790391338.935037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00010000:00010000:1.0:1790391338.938644:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.938687:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.938695:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.938701:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391338.938705:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.938714:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.938730:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962411373800) 00010000:00010000:1.0:1790391338.938733:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391338.938739:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391338.938746:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449aa1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391338.938979:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391338.939063:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108741248 00000100:00100000:2.0:1790391338.939073:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108741248 00000100:00100000:2.0:1790391338.939116:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:2.0:1790391338.939125:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1877361108741248:12345-192.168.201.8@tcp:8:bash.0 00010000:00080000:2.0:1790391338.939154:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:2.0:1790391338.939187:0:6694:0:(genops.c:1385:class_connect()) connect: client df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f, cookie 0x35e94fc15449aa31 00002000:00100000:2.0:1790391338.939195:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f/ffff962411a35000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790391338.939203:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790391338.939401:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790391338.939425:0:6694:0:(import.c:65:import_set_state_nolock()) ffff962411a36800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391338.939489:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2362:x1877361108741248:12345-192.168.201.8@tcp:8:bash.0 Request processed in 363us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391338.939505:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:1.0:1790391338.940862:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391338.940915:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108741376 00000100:00100000:0.0:1790391338.940923:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108741376 00000100:00080000:2.0:1790391338.940977:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391338.940986:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:0.0:1790391338.940996:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:0:x1877361108741376:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:0.0:1790391338.941011:0:8917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391338.941051:0:8917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fcfa expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391338.941077:0:8917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790391338.941095:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1790391338.941099:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391338.941107:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 7 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391338.941123:0:8917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 7 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391338.941146:0:8917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031a00, rc 0) 00000100:00100000:0.0:1790391338.941192:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:0:x1877361108741376:12345-192.168.201.8@tcp:101:bash.0 Request processed in 198us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391338.941199:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:1.0:1790391338.943172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391338.943213:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108741504 00000100:00100000:0.0:1790391338.943221:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108741504 00000100:00100000:2.0:1790391338.943326:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:2.0:1790391338.943337:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:10312:x1877361108741504:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391338.943353:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391338.943378:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.943401:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 8 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.943407:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391338.943410:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391338.943413:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.943436:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 8 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.943445:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 8 pid: 8917 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391338.943456:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1877361130795776:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391338.943533:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391338.945074:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1877361130795776:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391338.945122:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.945140:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11800, rc 0) 00000100:00100000:2.0:1790391338.945204:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:10312:x1877361108741504:12345-192.168.201.8@tcp:101:bash.0 Request processed in 1868us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391338.945212:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:1.0:1790391338.945477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391338.945620:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108741632 00000100:00100000:3.0:1790391338.945635:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108741632 00010000:00010000:3.0:1790391338.945677:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 8 pid: 8917 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391338.945711:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:3.0:1790391338.945720:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108741632:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391338.945742:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391338.945765:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 8 pid: 8917 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.945777:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 8 pid: 8917 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.945797:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000271c5e40/0x35e94fc15449aa38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcfa expref: 8 pid: 8917 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.945808:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391338.945810:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391338.945816:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.945823:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391338.945847:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391338.945857:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1877361130795904:192.168.201.8@tcp:105: 00000100:00100000:3.0:1790391338.945907:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff962410e2f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391338.948584:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1877361130795904:192.168.201.8@tcp:105: 00010000:00010000:3.0:1790391338.948609:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391338.948698:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108741632:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 2978us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391338.948709:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:0.0:1790391338.949209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391338.949341:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108741888 00000100:00100000:2.0:1790391338.949350:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108741888 00000100:00100000:2.0:1790391338.949475:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:2.0:1790391338.949485:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:10312:x1877361108741888:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:2.0:1790391338.949853:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10312:x1877361108741888:12345-192.168.201.8@tcp:35:bash.0 Request processed in 369us (645us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790391338.949858:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:0.0:1790391338.994808:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391338.994901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108742144 00000100:00100000:2.0:1790391338.994912:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108742144 00000100:00100000:2.0:1790391338.994982:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:2.0:1790391338.994993:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10322:x1877361108742144:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391338.995052:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391338.995074:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449aa46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391338.995235:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790391338.995348:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449aa46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd08 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.995384:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391338.995386:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391338.995390:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449aa46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd08 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391338.995400:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11e00, rc 0) 00000100:00100000:2.0:1790391338.995488:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:10322:x1877361108742144:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 496us (686us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1790391338.995495:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:1.0:1790391338.997831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391338.997907:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108742400 00000100:00100000:2.0:1790391338.997915:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108742400 00000100:00100000:2.0:1790391338.997975:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:2.0:1790391338.997983:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:10322:x1877361108742400:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:2.0:1790391338.998193:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:10322:x1877361108742400:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 211us (370us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790391338.998198:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1790391339.076447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391339.076538:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108742528 00000100:00100000:2.0:1790391339.076549:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108742528 00000100:00100000:2.0:1790391339.076615:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:2.0:1790391339.076627:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:10328:x1877361108742528:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391339.076660:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391339.076682:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449aa54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd0f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.076764:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449aa5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.076792:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449aa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.076804:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449aa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391339.076841:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790391339.076845:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391339.076863:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449aa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.076889:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449aa54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd0f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.076908:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449aa5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd0f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.076917:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391339.076920:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391339.076924:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10c00, rc 0) 00000100:00100000:2.0:1790391339.076989:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:10328:x1877361108742528:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 364us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391339.076996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:0.0:1790391339.079797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.079920:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108742784 00000100:00100000:3.0:1790391339.079929:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108742784 00000100:00100000:3.0:1790391339.079982:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:3.0:1790391339.079991:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:10328:x1877361108742784:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391339.080006:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391339.080041:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.080118:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.080128:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.080137:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391339.080148:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790391339.080343:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd16 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.080363:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd16 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.080373:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391339.080376:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391339.080394:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2e00, rc 0) 00000100:00100000:3.0:1790391339.081840:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10328:x1877361108742784:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 464us (667us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790391339.081852:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:1.0:1790391339.084121:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.084516:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108743040 00000100:00100000:3.0:1790391339.084527:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108743040 00000100:00100000:3.0:1790391339.084619:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:3.0:1790391339.084630:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10328:x1877361108743040:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391339.084664:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391339.084684:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aa77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd1d expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.084807:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.084821:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.084833:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391339.084845:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790391339.084963:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aa77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd1d expref: 22 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.084982:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd1d expref: 21 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.084990:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391339.084999:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790391339.085003:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3800, rc 0) 00000100:00100000:3.0:1790391339.085133:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10328:x1877361108743040:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 504us (1021us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790391339.085151:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:0.0:1790391339.089562:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391339.089701:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108743168 00000100:00100000:1.0:1790391339.089725:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108743168 00000100:00100000:1.0:1790391339.089797:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:1.0:1790391339.089807:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:2365:x1877361108743168:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391339.089836:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391339.089861:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449aa69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd16 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.089881:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373400) 00010000:00010000:1.0:1790391339.089886:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391339.089944:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:2365:x1877361108743168:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 139us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391339.089953:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:0.0:1790391339.092379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391339.092464:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108743296 00000100:00100000:1.0:1790391339.092474:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108743296 00000100:00100000:1.0:1790391339.092527:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:1.0:1790391339.092537:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108743296:12345-192.168.201.8@tcp:1:lfs.0 00010000:00010000:1.0:1790391339.092582:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.092603:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.092613:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391339.092617:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391339.092621:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.092670:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.092714:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 7 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391339.092730:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fb7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1877361130796032:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391339.092823:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391339.096619:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fb7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1877361130796032:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391339.096660:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391339.098010:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391339.098223:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108743424 00000100:00100000:2.0:1790391339.098233:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108743424 00002000:00100000:2.0:1790391339.098287:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff962439b75880 x1877361108743424/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:205/0 lens 504/0 e 0 to 0 dl 1790391350 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391339.098309:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962439b75880 with x1877361108743424 ext(0->12) 00010000:00010000:2.0:1790391339.098336:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 8 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.098354:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 8 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391339.098362:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff962439b75880 00000100:00100000:2.0:1790391339.098401:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391339.098411:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108743424:12345-192.168.201.8@tcp:4:lfs.0 00000001:00100000:0.0:1790391339.139962:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000100:00100000:1.0:1790391339.143373:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108743424:12345-192.168.201.8@tcp:4:lfs.0 Request processed in 44954us (45360us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790391339.143394:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00002000:00100000:1.0:1790391339.143408:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff962439b75880 x1877361108743424/t4294967299(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:205/0 lens 504/448 e 0 to 0 dl 1790391350 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391339.143418:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962439b75880 with x1877361108743424 ext(0->12) 00010000:00010000:1.0:1790391339.143428:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 9 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.143778:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 9 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391339.143788:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff962439b75880 00000100:00100000:2.0:1790391339.146560:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.146838:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108743552 00000100:00100000:3.0:1790391339.146847:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108743552 00010000:00010000:3.0:1790391339.146880:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 9 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.146948:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:3.0:1790391339.146959:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2363:x1877361108743552:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391339.146975:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790391339.146994:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790391339.146997:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790391338 00002000:00010000:3.0:1790391339.146999:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790391338 00002000:00010000:3.0:1790391339.147002:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790391338 00010000:00010000:3.0:1790391339.147009:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 9 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.147047:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 9 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.147066:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449aa3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd01 expref: 9 pid: 6694 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.147080:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391339.147095:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391339.147100:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.147107:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.147136:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391339.147186:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108743552:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 229us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391339.147193:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00010000:00010000:2.0:1790391339.147242:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147262:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147287:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147296:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147304:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147311:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391339.147322:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147332:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147345:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.147353:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041913d40/0x35e94fc15449aa8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391339.147403:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108743296:12345-192.168.201.8@tcp:1:lfs.0 Request processed in 54868us (55041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391339.147411:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:2.0:1790391339.149872:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391339.150096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108743808 00000100:00100000:0.0:1790391339.150107:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108743808 00000100:00100000:0.0:1790391339.150155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:0.0:1790391339.150165:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:10328:x1877361108743808:12345-192.168.201.8@tcp:35:lfs.0 00000004:00010000:0.0:1790391339.150224:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd1d expref: 20 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391339.150584:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1790391339.150685:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1790391339.151633:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1790391339.151808:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.151831:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.151838:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.151868:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.151878:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 24 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391339.151890:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b77100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1877361130796160:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391339.152045:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240e8a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391339.154292:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b77100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1877361130796160:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391339.154306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:0.0:1790391339.154321:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.154491:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108743936 00000100:00100000:3.0:1790391339.154497:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108743936 00010000:00010000:3.0:1790391339.154528:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 25 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.154560:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:3.0:1790391339.154566:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:2364:x1877361108743936:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391339.154577:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391339.154581:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 25 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.154590:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 25 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.154606:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aa23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcf3 expref: 25 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.154645:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391339.154660:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.154669:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.154678:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.154817:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.154820:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391339.154825:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.154907:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:2364:x1877361108743936:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 339us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391339.154914:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 37 00000001:00080000:0.0:1790391339.154962:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1790391339.155334:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1790391339.155459:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b77100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130796288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790391339.155549:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391339.155583:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240e8a2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391339.155677:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130796288 00000100:00100000:1.0:1790391339.155689:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130796288 00000100:00100000:1.0:1790391339.155859:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391339.155869:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1877361130796288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790391339.155958:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1877361130796288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391339.155965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391339.156062:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b77100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130796288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790391339.156894:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1790391339.156955:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130796416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790391339.156993:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391339.157043:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240e94c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391339.157058:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130796416 00000100:00100000:0.0:1790391339.157064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130796416 00000100:00100000:0.0:1790391339.157101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391339.157109:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1877361130796416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790391339.157270:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1877361130796416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (276us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790391339.157340:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391339.157356:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130796416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790391339.157444:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1790391339.157476:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.157486:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.157503:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.157510:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.157514:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.157520:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.157532:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391339.157535:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790391339.157538:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.157543:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449aa93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391339.157681:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790391339.157871:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1790391339.157879:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374491863154ns, next at 375491861938ns, rc = 0 00000001:00080000:3.0:1790391339.157884:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1790391339.157905:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391339.157907:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790391339.157912:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aa7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd1d expref: 28 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.158005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10328:x1877361108743808:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 7842us (8139us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1790391339.158048:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000020:00080000:3.0:1790391339.158052:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1790391339.158568:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391339.160811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.160888:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108744064 00000100:00100000:3.0:1790391339.160896:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108744064 00000100:00100000:3.0:1790391339.160964:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:3.0:1790391339.160973:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10328:x1877361108744064:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391339.160995:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391339.161202:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd24 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.161279:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd24 expref: 28 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.161294:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd24 expref: 28 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.161315:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.161319:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391339.161322:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2800, rc 0) 00000100:00100000:3.0:1790391339.161486:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:10328:x1877361108744064:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 513us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391339.161494:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:1.0:1790391339.163604:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.164084:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108744320 00000100:00100000:3.0:1790391339.164093:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108744320 00000100:00100000:3.0:1790391339.164137:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1790391339.164147:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:10328:x1877361108744320:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391339.164776:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10328:x1877361108744320:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 628us (1177us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1790391339.164785:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:2.0:1790391339.275545:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391339.275653:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108744576 00000100:00100000:1.0:1790391339.275664:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108744576 00000100:00100000:1.0:1790391339.275726:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:1.0:1790391339.275737:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10338:x1877361108744576:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391339.275763:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391339.275785:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449aaa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd2b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391339.275885:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790391339.276066:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449aaa1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd2b expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.276082:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391339.276085:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391339.276092:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449aaa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd2b expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.276106:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30400, rc 0) 00000100:00100000:1.0:1790391339.276161:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10338:x1877361108744576:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 425us (626us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1790391339.276185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:0.0:1790391339.279853:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.279936:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108744704 00000100:00100000:3.0:1790391339.279946:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108744704 00000100:00100000:3.0:1790391339.280005:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:3.0:1790391339.280062:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10338:x1877361108744704:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:3.0:1790391339.280140:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280158:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280171:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280186:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280193:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280199:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280303:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280312:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280337:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391339.280382:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280395:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280401:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280408:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280414:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.280418:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280426:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280438:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:3.0:1790391339.280441:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391339.280456:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280463:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aaaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280478:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280490:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280496:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280501:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.280504:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280509:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280516:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962411373400) 00010000:00010000:3.0:1790391339.280518:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391339.280521:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280526:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aab6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280541:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280547:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280551:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280556:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.280564:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280570:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280578:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.280580:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391339.280582:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.280588:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aabd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.280671:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10338:x1877361108744704:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 657us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391339.280678:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:0.0:1790391339.284116:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.284203:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108744960 00000100:00100000:3.0:1790391339.284213:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108744960 00000100:00100000:3.0:1790391339.284286:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:3.0:1790391339.284297:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10338:x1877361108744960:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391339.284597:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10338:x1877361108744960:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 301us (490us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1790391339.284605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391339.333132:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.333283:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108745216 00000100:00100000:3.0:1790391339.333294:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108745216 00000100:00100000:3.0:1790391339.333354:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:3.0:1790391339.333366:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10341:x1877361108745216:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391339.333391:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391339.333426:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd32 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333503:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333518:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333530:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333545:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333552:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333559:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333684:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333694:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333701:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391339.333711:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790391339.333806:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333823:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333831:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333837:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.333842:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333849:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333862:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:3.0:1790391339.333865:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391339.333870:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333876:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449aacb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333889:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333894:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333900:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.333907:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.334086:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.334094:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.334104:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962411373400) 00010000:00010000:3.0:1790391339.334107:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391339.334110:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.334116:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449aad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.334234:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449aac4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 34 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.334306:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 33 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.334315:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.334317:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391339.334321:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2000, rc 0) 00000100:00100000:3.0:1790391339.334436:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10341:x1877361108745216:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1071us (1314us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1790391339.334445:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1790391339.337978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391339.338275:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108745344 00000100:00100000:2.0:1790391339.338285:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108745344 00000100:00100000:2.0:1790391339.338344:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:2.0:1790391339.338355:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10341:x1877361108745344:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:2.0:1790391339.338423:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338440:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338478:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338507:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338516:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338524:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338530:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391339.338534:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338541:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338553:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391339.338557:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391339.338562:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.338570:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aae7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391339.338705:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10341:x1877361108745344:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 350us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391339.338713:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:2.0:1790391339.341746:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.341847:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108745600 00000100:00100000:3.0:1790391339.341856:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108745600 00000100:00100000:3.0:1790391339.342477:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:3.0:1790391339.342490:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10341:x1877361108745600:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391339.342746:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:10341:x1877361108745600:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 257us (1009us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1790391339.342754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00010000:00010000:3.0:1790391339.353492:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790391339.520356:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:2.0:1790391339.520386:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000001:00080000:2.0:1790391339.520403:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:2.0:1790391339.520413:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1790391339.520438:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96240e94c540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1790391339.520443:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962427eed600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96240e94c900 00000020:00080000:2.0:1790391339.520446:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962427eedf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96243fe73000 00000020:00080000:2.0:1790391339.520470:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1790391339.520596:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790391339.520776:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391339.520796:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130796544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790391339.520867:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391339.520948:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130796544 00000100:00100000:0.0:1790391339.520956:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130796544 00000100:00100000:0.0:1790391339.520999:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391339.521008:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130796544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790391339.521057:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1790391339.521096:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6ab7342a, atime: 0x6ab7342a, ctime: 0x6ab7342a, blocks: 0x1 00010000:00010000:0.0:1790391339.521106:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521124:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1790391339.521129:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391339.521136:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521180:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521192:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521200:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521219:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790391339.521873:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1877361130796544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 863us (1003us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790391339.521882:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1790391339.521909:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391339.521916:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521925:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391339.521930:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521940:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521957:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521972:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000310572fc/0x35e94fc15449aaee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391339.521992:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391339.521994:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391339.521996:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790391339.522060:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962439b77480/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790391339.522068:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130796544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790391339.599139:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391339.599310:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108745856 00000100:00100000:2.0:1790391339.599320:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108745856 00000100:00100000:2.0:1790391339.599377:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:2.0:1790391339.599388:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:10372:x1877361108745856:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:2.0:1790391339.599416:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391339.599437:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aaf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd39 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.599544:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aafc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.599558:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aafc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.599570:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aafc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391339.599580:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790391339.599854:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aaf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd39 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.599892:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aafc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd39 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.599901:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391339.599904:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391339.599907:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11c00, rc 0) 00000100:00100000:2.0:1790391339.599973:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10372:x1877361108745856:12345-192.168.201.8@tcp:101:cat.0 Request processed in 586us (842us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790391339.599981:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:0.0:1790391339.604339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391339.604397:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391339.604422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108746112 00000100:00100000:2.0:1790391339.604434:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108746112 00000100:00100000:3.0:1790391339.604463:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108746240 00000100:00100000:3.0:1790391339.604467:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108746240 00000100:00100000:2.0:1790391339.604506:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:3.0:1790391339.604507:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:3.0:1790391339.604517:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962408362050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:2363:x1877361108746240:12345-192.168.201.8@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790391339.604517:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:10372:x1877361108746112:12345-192.168.201.8@tcp:35:cat.0 00010000:00010000:3.0:1790391339.604531:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391339.604557:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aafc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd39 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.604574:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.604579:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391339.604626:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962408362050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:2363:x1877361108746240:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 111us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391339.604632:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:2.0:1790391339.604735:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10372:x1877361108746112:12345-192.168.201.8@tcp:35:cat.0 Request processed in 219us (407us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1790391339.604742:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1790391339.670519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391339.670620:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108746496 00000100:00100000:1.0:1790391339.670630:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108746496 00000100:00100000:1.0:1790391339.670704:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:1.0:1790391339.670716:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10378:x1877361108746496:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:1.0:1790391339.670744:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391339.670748:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790391339.670776:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449aa5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd0f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.670796:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391339.670801:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391339.670816:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ab0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd40 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.670916:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.670931:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 14 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.670940:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.670972:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 14 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.671005:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 14 pid: 11443 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391339.671069:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fb7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130796672:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391339.671440:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391339.676946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.677076:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108746624 00000100:00100000:3.0:1790391339.677085:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108746624 00010000:00010000:3.0:1790391339.677127:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 15 pid: 11443 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.677183:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:3.0:1790391339.677194:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:2364:x1877361108746624:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391339.677210:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391339.677217:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 15 pid: 11443 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.677423:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 15 pid: 11443 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.677462:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.677469:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.677479:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.677487:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.677511:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391339.677608:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:2364:x1877361108746624:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 416us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391339.677617:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 38 00010000:00010000:2.0:1790391339.677732:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449aad9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd32 expref: 14 pid: 11443 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391339.677751:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fb7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130796672:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391339.677774:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.677784:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.677801:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391339.677821:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790391339.678004:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ab0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.678066:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.678075:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391339.678078:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391339.678080:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30600, rc 0) 00000100:00100000:2.0:1790391339.678112:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10378:x1877361108746496:12345-192.168.201.8@tcp:101:dd.0 Request processed in 7399us (7604us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1790391339.678118:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:3.0:1790391339.681972:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391339.682173:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108746880 00000100:00100000:1.0:1790391339.682183:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108746880 00000100:00100000:1.0:1790391339.682276:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:1.0:1790391339.682286:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10378:x1877361108746880:12345-192.168.201.8@tcp:36:dd.0 00010000:00010000:1.0:1790391339.682564:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.682582:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.682594:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391339.682674:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1790391339.682700:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086bc82ec reply state 000000004163ca2f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391339.682708:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391339.682805:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:10378:x1877361108746880:12345-192.168.201.8@tcp:36:dd.0 Request processed in 519us (842us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1790391339.682812:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00000020:00080000:1.0:1790391339.682822:0:8292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790391339.684742:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.684760:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.684769:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.684775:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.684780:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.684802:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.684821:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.684824:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391339.684829:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.684836:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ab1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.890703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391339.891150:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108747008 00000100:00100000:2.0:1790391339.891162:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108747008 00000100:00100000:2.0:1790391339.891229:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:2.0:1790391339.891247:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:10392:x1877361108747008:12345-192.168.201.8@tcp:101:stat.0 00010000:00010000:2.0:1790391339.891271:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391339.891291:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449ab26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd47 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891353:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891385:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891396:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891412:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891419:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891426:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891729:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891741:0:11443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891749:0:11443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891782:0:11443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.891795:0:11443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 17 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391339.891822:0:11443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130796800:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391339.891905:0:11443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624071b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391339.895306:0:11443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130796800:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391339.895336:0:11443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.896535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391339.896645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108747264 00000100:00100000:0.0:1790391339.896656:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108747264 00000100:00100000:0.0:1790391339.896758:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:0.0:1790391339.896766:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:5603:x1877361108747264:12345-192.168.201.8@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790391339.897155:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:5603:x1877361108747264:12345-192.168.201.8@tcp:35:ldlm_bl.0 Request processed in 388us (625us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1790391339.897163:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:1.0:1790391339.900302:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391339.900428:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108747392 00000100:00100000:3.0:1790391339.900447:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108747392 00010000:00010000:3.0:1790391339.900487:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 19 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391339.900564:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1790391339.900575:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:2364:x1877361108747392:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391339.900590:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391339.900597:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 19 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.900621:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 19 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.900657:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ab11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd40 expref: 19 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.900689:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.900695:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.900705:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.900714:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.900747:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391339.900798:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:2364:x1877361108747392:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 224us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391339.900805:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00010000:00010000:1.0:1790391339.901156:0:11443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901164:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391339.901211:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790391339.901216:0:11443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391339.901259:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901274:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901285:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901292:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901299:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901304:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391339.901309:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901317:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901328:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391339.901342:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391339.901347:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901353:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ab2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901366:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901373:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901379:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901383:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391339.901386:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901392:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901400:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96240bf85500) 00010000:00010000:1.0:1790391339.901402:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391339.901405:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901410:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449ab34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901571:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449ab26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd47 expref: 18 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901600:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd47 expref: 17 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391339.901677:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391339.901680:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391339.901682:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11a00, rc 0) 00000100:00100000:1.0:1790391339.901714:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:10392:x1877361108747008:12345-192.168.201.8@tcp:101:stat.0 Request processed in 10477us (11023us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391339.901721:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:3.0:1790391339.929416:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391339.929448:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130796928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391339.929516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391339.930426:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130796928 00000100:00100000:2.0:1790391339.930448:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130796928 00000100:00100000:2.0:1790391339.930529:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790391339.930541:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130796928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391339.930584:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391339.930836:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130796928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 297us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391339.930843:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1790391339.930949:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391339.930989:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130796928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391339.989729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391339.990127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108747648 00000100:00100000:2.0:1790391339.990138:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108747648 00000100:00100000:2.0:1790391339.990258:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:2.0:1790391339.990269:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:10398:x1877361108747648:12345-192.168.201.8@tcp:36:truncate.0 00010000:00010000:2.0:1790391339.990325:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391339.990352:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd47 expref: 17 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.990371:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391339.990376:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391339.990581:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.990607:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391339.990617:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391339.990700:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1790391339.990724:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef8ac921 reply state 0000000002a6c19a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391339.990734:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391339.990855:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10398:x1877361108747648:12345-192.168.201.8@tcp:36:truncate.0 Request processed in 587us (1134us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790391339.990862:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 54 00000020:00080000:2.0:1790391339.990866:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790391339.992490:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.992504:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.992512:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.992536:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391339.992541:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.992550:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.992566:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391339.992569:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391339.992573:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391339.992579:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ab42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391340.094947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391340.095440:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108747776 00000100:00100000:1.0:1790391340.095451:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108747776 00000100:00100000:1.0:1790391340.095541:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:1.0:1790391340.095554:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:10412:x1877361108747776:12345-192.168.201.8@tcp:101:stat.0 00010000:00010000:1.0:1790391340.095581:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391340.095603:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ab49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd4e expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.095680:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.095694:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.095704:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.095720:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.095741:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.095749:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096075:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096085:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096094:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391340.096133:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1790391340.096138:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391340.096156:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096167:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096175:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096181:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096187:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096204:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391340.096208:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096216:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096229:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391340.096231:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:3.0:1790391340.096704:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790391340.096738:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096747:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ab50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096763:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096768:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096774:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096780:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391340.096783:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096789:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096810:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9624119e7700) 00010000:00010000:1.0:1790391340.096812:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391340.096815:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096820:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ab57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096858:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ab49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 20 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096870:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 19 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.096877:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391340.096879:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391340.096881:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30c00, rc 0) 00000100:00100000:1.0:1790391340.097607:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10412:x1877361108747776:12345-192.168.201.8@tcp:101:stat.0 Request processed in 2051us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391340.097616:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:1.0:1790391340.227255:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.227515:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108748032 00000100:00100000:2.0:1790391340.227526:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108748032 00000100:00100000:2.0:1790391340.227592:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:2.0:1790391340.227603:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10422:x1877361108748032:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391340.227658:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391340.227678:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd55 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391340.227767:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790391340.227885:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd55 expref: 21 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.227899:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391340.227916:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391340.227924:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd55 expref: 21 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.227938:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11a00, rc 0) 00000100:00100000:2.0:1790391340.228002:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:10422:x1877361108748032:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 400us (767us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1790391340.228010:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:0.0:1790391340.233812:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.233895:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108748288 00000100:00100000:2.0:1790391340.233905:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108748288 00000100:00100000:2.0:1790391340.233977:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391340.233988:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:10422:x1877361108748288:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:2.0:1790391340.234273:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10422:x1877361108748288:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 286us (469us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1790391340.234281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:3.0:1790391340.325611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.325705:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108748544 00000100:00100000:2.0:1790391340.325715:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108748544 00000100:00100000:2.0:1790391340.325776:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:2.0:1790391340.325787:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10428:x1877361108748544:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391340.325811:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391340.325832:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd5c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.325932:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.325948:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 22 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.325971:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.326005:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 22 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.326063:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 22 pid: 8292 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391340.326078:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130797056:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391340.326331:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624071b7180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391340.330885:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391340.330952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108748672 00000100:00100000:3.0:1790391340.330962:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108748672 00010000:00010000:3.0:1790391340.331002:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 23 pid: 8292 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391340.331166:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1790391340.331178:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:2364:x1877361108748672:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391340.331192:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391340.331198:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 23 pid: 8292 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.331231:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 23 pid: 8292 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.331255:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391340.331261:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.331270:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.331277:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.331298:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391340.331356:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:2364:x1877361108748672:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 179us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391340.331364:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00010000:00010000:2.0:1790391340.331454:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ab5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd4e expref: 22 pid: 8292 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391340.331472:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130797056:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391340.331491:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.331500:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.331506:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391340.331523:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1790391340.331817:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.331847:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.331856:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391340.331859:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391340.331861:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10000, rc 0) 00000100:00100000:2.0:1790391340.331899:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:10428:x1877361108748544:12345-192.168.201.8@tcp:101:bash.0 Request processed in 6114us (6306us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1790391340.331905:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:1.0:1790391340.337508:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391340.337714:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108748928 00000100:00100000:3.0:1790391340.337724:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108748928 00000100:00100000:3.0:1790391340.337785:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:3.0:1790391340.337796:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:10428:x1877361108748928:12345-192.168.201.8@tcp:36:bash.0 00010000:00010000:3.0:1790391340.338363:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.338380:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.338390:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391340.338717:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1790391340.338748:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b34a887c reply state 0000000034e47503 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391340.338757:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391340.338857:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:10428:x1877361108748928:12345-192.168.201.8@tcp:36:bash.0 Request processed in 1060us (1355us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1790391340.338866:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 58 00000020:00080000:3.0:1790391340.338872:0:8292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790391340.343657:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.343677:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.343685:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.343691:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391340.343697:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.343705:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.343723:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391340.343726:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391340.343731:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.343738:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ab88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391340.347807:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391340.347885:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108749056 00000100:00100000:0.0:1790391340.347898:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108749056 00000100:00100000:0.0:1790391340.361133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:0.0:1790391340.361154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:10428:x1877361108749056:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:0.0:1790391340.361181:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391340.361215:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ab8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.361305:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.361320:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.361330:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.361368:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.361382:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 25 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391340.361395:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130797184:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391340.361482:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240e8a2600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391340.364708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391340.364850:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108749184 00000100:00100000:3.0:1790391340.364860:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108749184 00010000:00010000:3.0:1790391340.364904:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 26 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391340.364923:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130797184:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391340.364953:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391340.364964:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:3.0:1790391340.364977:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:2363:x1877361108749184:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391340.364993:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391340.365000:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 26 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.365043:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 26 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.365070:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ab7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd5c expref: 26 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.365087:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391340.365092:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.365104:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.365112:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.365142:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391340.365200:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391340.365210:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:2363:x1877361108749184:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 233us (511us total) trans 0 rc 0/0 00010000:00010000:2.0:1790391340.365212:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391340.365226:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 41 00000004:00200000:2.0:1790391340.365268:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790391340.365273:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391340.365297:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.365331:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ab8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd63 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.365347:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd63 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.365362:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391340.365365:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391340.365369:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031800, rc 0) 00000100:00100000:2.0:1790391340.365399:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:10428:x1877361108749056:12345-192.168.201.8@tcp:101:bash.0 Request processed in 4253us (17602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391340.365407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:1.0:1790391340.369587:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.369781:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108749440 00000100:00100000:2.0:1790391340.369791:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108749440 00000100:00100000:1.0:1790391340.370041:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:1.0:1790391340.370055:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:10428:x1877361108749440:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:1.0:1790391340.370320:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:10428:x1877361108749440:12345-192.168.201.8@tcp:35:bash.0 Request processed in 267us (743us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1790391340.370328:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00010000:00010000:3.0:1790391340.377127:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391340.467579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.467788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108749696 00000100:00100000:2.0:1790391340.467808:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108749696 00000100:00100000:2.0:1790391340.467876:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:2.0:1790391340.467888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:10438:x1877361108749696:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391340.467918:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391340.467940:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd6a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391340.468087:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790391340.468219:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd6a expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.468235:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391340.468238:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391340.468244:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ab9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd6a expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.468258:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11a00, rc 0) 00000100:00100000:2.0:1790391340.468329:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10438:x1877361108749696:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 444us (767us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790391340.468337:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:2.0:1790391340.472657:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391340.472808:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108749824 00000100:00100000:3.0:1790391340.472823:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108749824 00000100:00100000:3.0:1790391340.472911:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:3.0:1790391340.472924:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10438:x1877361108749824:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:3.0:1790391340.473254:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473277:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473292:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473310:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473317:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473323:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473829:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473841:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473861:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391340.473927:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473945:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473951:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473959:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473966:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391340.473971:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473981:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.473998:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:3.0:1790391340.474002:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391340.474008:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.475990:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449abab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476035:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476066:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476075:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476081:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391340.476086:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476095:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476117:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962411373700) 00010000:00010000:3.0:1790391340.476121:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391340.476126:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476133:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476162:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476169:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476175:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476181:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391340.476191:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476198:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476207:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391340.476210:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391340.476213:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.476220:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391340.477523:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10438:x1877361108749824:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 4591us (4872us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391340.477538:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:3.0:1790391340.483851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391340.484059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108750080 00000100:00100000:0.0:1790391340.484073:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108750080 00000100:00100000:0.0:1790391340.484141:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:0.0:1790391340.484153:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10438:x1877361108750080:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391340.484572:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10438:x1877361108750080:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 420us (734us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1790391340.484597:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1790391340.541699:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.542356:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108750336 00000100:00100000:2.0:1790391340.542370:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108750336 00000100:00100000:2.0:1790391340.542459:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:2.0:1790391340.542472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10441:x1877361108750336:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391340.542506:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391340.542534:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449abc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.542653:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.542670:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.542686:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.542704:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.542712:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.542719:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543469:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449abd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543492:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449abd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543502:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449abd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391340.543515:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790391340.543694:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543703:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543711:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543718:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391340.543724:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543733:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543749:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391340.543752:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391340.543759:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543766:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543782:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543795:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543802:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543807:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391340.543810:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543816:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543824:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96240bf85400) 00010000:00010000:2.0:1790391340.543827:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391340.543830:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543836:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449abce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543895:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449abc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd71 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543911:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449abd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd71 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.543919:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391340.543921:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391340.543932:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10200, rc 0) 00000100:00100000:2.0:1790391340.547889:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10441:x1877361108750336:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 5400us (6187us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1790391340.547906:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:2.0:1790391340.555273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391340.555733:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108750464 00000100:00100000:3.0:1790391340.555747:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108750464 00000100:00100000:3.0:1790391340.555844:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:3.0:1790391340.555858:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:2363:x1877361108750464:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391340.555876:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391340.555908:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449abd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd71 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.555935:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391340.555942:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391340.556060:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:2363:x1877361108750464:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 205us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391340.556085:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:3.0:1790391340.556737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391340.556810:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108750592 00000100:00100000:1.0:1790391340.556819:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108750592 00000100:00100000:1.0:1790391340.556878:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:1.0:1790391340.556888:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:10441:x1877361108750592:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:1.0:1790391340.556973:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.556993:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557007:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557096:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557104:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557111:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557117:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391340.557122:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557146:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557156:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391340.557159:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391340.557165:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.557172:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449abe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391340.557258:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:10441:x1877361108750592:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 370us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391340.557266:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:2.0:1790391340.569658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391340.569725:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108750848 00000100:00100000:0.0:1790391340.569740:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108750848 00000100:00100000:0.0:1790391340.569825:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:0.0:1790391340.569837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:10441:x1877361108750848:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391340.570589:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10441:x1877361108750848:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 750us (980us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790391340.570599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:0.0:1790391340.712712:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391340.712802:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108751104 00000100:00100000:3.0:1790391340.712813:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108751104 00000100:00100000:3.0:1790391340.712874:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:3.0:1790391340.712885:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10459:x1877361108751104:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:3.0:1790391340.712908:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391340.713197:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd78 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.713313:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abf1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.713328:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.713341:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391340.713353:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790391340.713618:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449abea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd78 expref: 32 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.713650:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd78 expref: 31 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391340.713661:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391340.713664:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790391340.713682:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3800, rc 0) 00000100:00100000:3.0:1790391340.713769:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10459:x1877361108751104:12345-192.168.201.8@tcp:101:cat.0 Request processed in 885us (1065us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1790391340.713778:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:3.0:1790391340.758967:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.759647:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108751232 00000100:00100000:2.0:1790391340.759658:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108751232 00000100:00100000:2.0:1790391340.759721:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:2.0:1790391340.759730:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10460:x1877361108751232:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391340.759754:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391340.759774:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.759839:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ac06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.759854:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ac06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.759866:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ac06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391340.759900:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790391340.759904:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391340.759932:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ac06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.759957:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449abff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd7f expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.759993:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ac06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd7f expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.760003:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391340.760006:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391340.760009:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10800, rc 0) 00000100:00100000:2.0:1790391340.760281:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10460:x1877361108751232:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 550us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391340.760289:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:2.0:1790391340.765099:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391340.765201:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108751616 00000100:00100000:1.0:1790391340.765211:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108751616 00000100:00100000:1.0:1790391340.765276:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1790391340.765287:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10460:x1877361108751616:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:1.0:1790391340.765598:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10460:x1877361108751616:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 312us (508us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1790391340.765605:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1790391340.769012:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391340.769180:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108751744 00000100:00100000:0.0:1790391340.769190:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108751744 00000100:00100000:0.0:1790391340.769265:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1790391340.769276:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10460:x1877361108751744:12345-192.168.201.8@tcp:103:lfs.0 00010000:00010000:0.0:1790391340.769291:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790391340.769315:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ab96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd63 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.769334:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449abf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd78 expref: 32 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.769346:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449aa9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd24 expref: 31 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391340.769356:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391340.769382:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391340.769464:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10460:x1877361108751744:12345-192.168.201.8@tcp:103:lfs.0 Request processed in 189us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391340.769472:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:3.0:1790391340.783825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391340.784054:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108751872 00000100:00100000:2.0:1790391340.784065:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108751872 00000100:00100000:2.0:1790391340.784122:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:2.0:1790391340.784132:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10460:x1877361108751872:12345-192.168.201.8@tcp:58:lfs.0 00010000:00010000:2.0:1790391340.784259:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.784274:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391340.784285:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391340.784917:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391340.785135:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790391340.785202:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790391340.785312:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10460:x1877361108751872:12345-192.168.201.8@tcp:58:lfs.0 Request processed in 1179us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391340.785329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:2.0:1790391340.820285:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391340.820460:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108752000 00000100:00100000:1.0:1790391340.820471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108752000 00000100:00100000:1.0:1790391340.820527:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:1.0:1790391340.820537:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10462:x1877361108752000:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391340.820556:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391340.820587:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ac14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd86 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.820661:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.820676:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.820687:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.820701:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.820708:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.820714:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821081:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821090:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821097:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391340.821132:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790391340.821136:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391340.821153:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821170:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821178:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821185:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821192:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821199:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391340.821204:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821211:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821281:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391340.821284:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391340.821289:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821297:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449ac1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821310:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821316:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821328:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821334:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391340.821336:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821343:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821350:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9624119e7700) 00010000:00010000:1.0:1790391340.821353:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391340.821356:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.821361:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.822659:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449ac14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.822680:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391340.822688:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:1.0:1790391340.822690:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391340.822693:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31e00, rc 0) 00000100:00100000:1.0:1790391340.822776:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10462:x1877361108752000:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 2239us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391340.822801:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 67 00010000:00010000:0.0:1790391341.401660:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391341.529693:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391341.529703:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391341.529763:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790391341.529770:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391341.529903:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130797312:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790391341.530062:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391341.538615:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130797312:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391341.540879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.541058:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108752128 00000100:00100000:2.0:1790391341.541069:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108752128 00000100:00100000:2.0:1790391341.541128:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:2.0:1790391341.541139:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10473:x1877361108752128:12345-192.168.201.8@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790391341.541226:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10473:x1877361108752128:12345-192.168.201.8@tcp:900:lhsmtool_posix.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391341.541235:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:2.0:1790391341.545439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391341.546033:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108752256 00000100:00100000:1.0:1790391341.546045:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108752256 00000100:00100000:1.0:1790391341.546111:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:1.0:1790391341.546121:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10473:x1877361108752256:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790391341.546151:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790391341.546270:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10473:x1877361108752256:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 149us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.546277:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:3.0:1790391341.552403:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391341.554551:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108752384 00000100:00100000:0.0:1790391341.554567:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108752384 00000100:00100000:0.0:1790391341.554865:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 69 00000100:00100000:0.0:1790391341.554875:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10473:x1877361108752384:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790391341.555352:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555371:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555384:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555403:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555410:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555417:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555446:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555454:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555474:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391341.555514:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790391341.555518:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391341.555534:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555544:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555550:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555556:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555562:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391341.555566:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555573:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555669:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:0.0:1790391341.555673:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391341.555679:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555685:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ac30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555706:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555712:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555718:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555722:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391341.555726:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555731:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555739:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff962430751a00) 00010000:00010000:0.0:1790391341.555742:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391341.555744:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555750:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ac37 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555764:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555770:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555776:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555787:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391341.555790:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555797:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555804:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:0.0:1790391341.555806:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391341.555809:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.555815:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ac3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391341.555956:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10473:x1877361108752384:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 Request processed in 1080us (3560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391341.555965:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 69 00000100:00100000:1.0:1790391341.567514:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.567615:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108752640 00000100:00100000:3.0:1790391341.567626:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108752640 00000100:00100000:3.0:1790391341.567686:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 70 00000100:00100000:3.0:1790391341.567697:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10473:x1877361108752640:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391341.567718:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391341.567740:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.567847:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.567863:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.567877:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391341.567888:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790391341.568000:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568008:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568052:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568057:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391341.568061:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568069:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568080:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:3.0:1790391341.568083:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391341.568088:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568094:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568131:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac45 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd8d expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568142:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:3.0:1790391341.568144:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391341.568149:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd8d expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.568158:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3200, rc 0) 00000100:00100000:3.0:1790391341.568219:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10473:x1877361108752640:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 523us (715us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1790391341.568236:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 70 00000100:00100000:0.0:1790391341.572407:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391341.573144:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108752768 00000100:00100000:1.0:1790391341.573154:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108752768 00000100:00100000:1.0:1790391341.573216:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 71 00000100:00100000:1.0:1790391341.573226:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10473:x1877361108752768:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790391341.573267:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790391341.573379:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10473:x1877361108752768:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 154us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.573387:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 71 00000100:00100000:3.0:1790391341.577238:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.577278:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108753024 00000100:00100000:3.0:1790391341.577289:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108753024 00000100:00100000:3.0:1790391341.577341:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:3.0:1790391341.577350:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10473:x1877361108753024:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391341.577370:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391341.577373:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790391341.577398:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ac06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd7f expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.577416:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:3.0:1790391341.577422:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391341.577435:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449ac5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd94 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391341.581636:0:8292:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1790391341.582191:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.582209:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.582222:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.582300:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449ac5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd94 expref: 34 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.582336:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd94 expref: 33 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.582346:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373700) 00010000:00010000:3.0:1790391341.582349:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391341.582353:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3200, rc 0) 00000100:00100000:3.0:1790391341.582426:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10473:x1877361108753024:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 5077us (5198us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1790391341.582437:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:0.0:1790391341.593378:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391341.593691:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108753280 00000100:00100000:1.0:1790391341.593702:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108753280 00000100:00100000:1.0:1790391341.593765:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00100000:1.0:1790391341.593777:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10473:x1877361108753280:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391341.593840:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391341.593873:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449ac61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd94 expref: 33 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.593894:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373700) 00010000:00010000:1.0:1790391341.593918:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391341.593944:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.593957:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.593968:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.593981:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.593987:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.593993:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594252:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594261:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594269:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594275:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391341.594287:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594295:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594304:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391341.594307:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391341.594311:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594319:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ac6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594329:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594336:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594341:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594347:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391341.594350:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594356:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594363:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4a75fd74 (ffff9624119e7700) 00010000:00010000:1.0:1790391341.594366:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391341.594376:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.594383:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449ac76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4a75fd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391341.594469:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10473:x1877361108753280:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 694us (1103us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391341.594477:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00100000:1.0:1790391341.597765:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.597854:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108753408 00000100:00100000:3.0:1790391341.597863:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108753408 00000100:00100000:3.0:1790391341.597927:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 74 00000100:00100000:3.0:1790391341.597938:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10473:x1877361108753408:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391341.597959:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391341.597983:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449ac7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fd9b expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.598043:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.598059:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.598071:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.598169:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449ac7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 34 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.598196:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 33 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.598205:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391341.598208:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391341.598212:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3600, rc 0) 00000100:00100000:3.0:1790391341.598272:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10473:x1877361108753408:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 336us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391341.598279:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 74 00000100:00100000:1.0:1790391341.606126:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.606206:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108753664 00000100:00100000:3.0:1790391341.606215:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108753664 00000100:00100000:3.0:1790391341.606271:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 75 00000100:00100000:3.0:1790391341.606281:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10473:x1877361108753664:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790391341.606380:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.606399:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.606411:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391341.606696:0:8292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1790391341.606706:0:8292:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376940689949ns, next at 377940687259ns, rc = 0 00000004:00010000:3.0:1790391341.606784:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce88cd63 reply state 0000000079d3ec9c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391341.606805:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391341.606895:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:10473:x1877361108753664:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 614us (779us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1790391341.606902:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 75 00000100:00100000:1.0:1790391341.613303:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391341.613342:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108753792 00000100:00100000:1.0:1790391341.613350:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108753792 00000100:00100000:1.0:1790391341.613400:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00100000:1.0:1790391341.613411:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:10473:x1877361108753792:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391341.613433:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391341.613453:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fda2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.613513:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.613527:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.613544:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:1.0:1790391341.613548:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391341.613566:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30e00, rc 0) 00000100:00100000:1.0:1790391341.613634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:10473:x1877361108753792:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 225us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.613641:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 76 00010000:00010000:3.0:1790391341.613952:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.613962:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.613970:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.613976:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391341.613980:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.613988:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.614001:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391341.614003:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790391341.614007:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.614044:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449ac8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391341.622192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.622284:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108753920 00000100:00100000:2.0:1790391341.622296:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108753920 00000100:00100000:2.0:1790391341.622342:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:2.0:1790391341.622351:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2362:x1877361108753920:12345-192.168.201.8@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1790391341.622383:0:8917:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:2.0:1790391341.622413:0:8917:0:(genops.c:1385:class_connect()) connect: client df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f, cookie 0x35e94fc15449ac99 00002000:00100000:2.0:1790391341.622426:0:8917:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f/ffff962403a85000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790391341.622436:0:8917:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790391341.622713:0:8917:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790391341.622740:0:8917:0:(import.c:65:import_set_state_nolock()) ffff962403a85800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391341.622803:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2362:x1877361108753920:12345-192.168.201.8@tcp:8:lhsmtool_posix.0 Request processed in 452us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391341.622812:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:1.0:1790391341.639809:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391341.646206:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108754048 00000100:00100000:0.0:1790391341.646224:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108754048 00000100:00100000:0.0:1790391341.646352:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:0.0:1790391341.646364:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:0:x1877361108754048:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790391341.651165:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1790391341.679876:0:12013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790391341.679888:0:12013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790391341.679936:0:12013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790391341.679942:0:12013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790391341.767320:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:0:x1877361108754048:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 120944us (127505us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790391341.767336:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 27 00000001:00080000:0.0:1790391341.767377:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1790391341.767397:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000100:00100000:3.0:1790391341.779473:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391341.779594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108754304 00000100:00100000:0.0:1790391341.779612:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108754304 00000100:00100000:0.0:1790391341.779678:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:0.0:1790391341.779688:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:10473:x1877361108754304:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790391341.779917:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:10473:x1877361108754304:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 230us (455us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1790391341.779925:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:0.0:1790391341.787506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.787683:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108754560 00000100:00100000:3.0:1790391341.787694:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108754560 00000100:00100000:3.0:1790391341.787757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:3.0:1790391341.787769:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:10473:x1877361108754560:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790391341.787884:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:10473:x1877361108754560:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 117us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391341.787892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:1.0:1790391341.793721:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.793809:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108754688 00000100:00100000:2.0:1790391341.793820:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108754688 00000100:00100000:2.0:1790391341.793880:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:2.0:1790391341.793891:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:10473:x1877361108754688:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391341.793913:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391341.793935:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aca0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fda9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.794005:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449aca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.794066:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449aca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.794081:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449aca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391341.794133:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391341.794154:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449aca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.794184:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aca0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda9 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.794232:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449aca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda9 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.794241:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:2.0:1790391341.794244:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790391341.794249:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11000, rc 0) 00000100:00100000:2.0:1790391341.794310:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:10473:x1877361108754688:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 420us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391341.794317:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:3.0:1790391341.799707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.799783:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108754816 00000100:00100000:2.0:1790391341.799794:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108754816 00000100:00100000:2.0:1790391341.799853:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:2.0:1790391341.799865:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2363:x1877361108754816:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391341.799884:0:8917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391341.799906:0:8917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdb0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391341.799934:0:8917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab7342d, blocks: 0x1 00010000:00010000:2.0:1790391341.799953:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1790391341.799957:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391341.799967:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 6 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.799989:0:8917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 6 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.800048:0:8917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11800, rc 0) 00000100:00100000:2.0:1790391341.800121:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108754816:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 248us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391341.800130:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:1.0:1790391341.805533:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.805682:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108755072 00000100:00100000:3.0:1790391341.805693:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108755072 00000100:00100000:3.0:1790391341.805789:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 79 00000100:00100000:3.0:1790391341.805800:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:10473:x1877361108755072:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790391341.805906:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:10473:x1877361108755072:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391341.805915:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 79 00000100:00100000:3.0:1790391341.816466:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391341.816853:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108755200 00000100:00100000:1.0:1790391341.816863:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108755200 00000100:00100000:1.0:1790391341.816931:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:1.0:1790391341.816943:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:10473:x1877361108755200:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391341.816963:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391341.816986:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdb7 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.817043:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 7 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.817053:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391341.817058:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391341.817065:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.817103:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 7 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.817145:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 7 pid: 8917 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391341.817161:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439988000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130797440:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391341.817278:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49e240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391341.825263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391341.825447:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439988000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130797440:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391341.825481:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.825502:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31c00, rc 0) 00000100:00100000:1.0:1790391341.825564:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:10473:x1877361108755200:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 8623us (9108us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.825572:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:2.0:1790391341.826553:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108755328 00000100:00100000:2.0:1790391341.826564:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108755328 00010000:00010000:3.0:1790391341.826773:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 7 pid: 8917 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391341.826820:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:3.0:1790391341.826831:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108755328:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391341.826847:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391341.826882:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 7 pid: 8917 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.826897:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 7 pid: 8917 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.826922:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2025542/0x35e94fc15449acae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb0 expref: 7 pid: 8917 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.826938:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391341.826943:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391341.826951:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.826961:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.826997:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391341.827044:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1877361130797568:192.168.201.8@tcp:105: 00000100:00100000:3.0:1790391341.827310:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a93900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391341.830664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.830872:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f722d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1877361130797568:192.168.201.8@tcp:105: 00010000:00010000:2.0:1790391341.830895:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391341.830953:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108755328:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 4123us (5698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391341.830964:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:0.0:1790391341.832570:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108755456 00000100:00100000:0.0:1790391341.833095:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108755456 00002000:00100000:0.0:1790391341.833295:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff96243f565880 x1877361108755456/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:207/0 lens 504/0 e 0 to 0 dl 1790391352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391341.833308:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96243f565880 with x1877361108755456 ext(0->8) 00002000:00010000:0.0:1790391341.833314:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96243f565880 00000100:00100000:0.0:1790391341.833351:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:0.0:1790391341.833363:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108755456:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790391341.835874:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108755456:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 Request processed in 2505us (5210us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790391341.835889:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00002000:00100000:0.0:1790391341.835901:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff96243f565880 x1877361108755456/t4294967302(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:207/0 lens 504/448 e 0 to 0 dl 1790391352 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391341.835911:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96243f565880 with x1877361108755456 ext(0->8) 00002000:00010000:0.0:1790391341.835917:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96243f565880 00000100:00100000:3.0:1790391341.839657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391341.839794:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108755584 00000100:00100000:0.0:1790391341.839812:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108755584 00000100:00100000:0.0:1790391341.839878:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 80 00000100:00100000:0.0:1790391341.839889:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:10473:x1877361108755584:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790391341.931513:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1790391341.931552:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1790391341.931561:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1790391341.931576:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1790391341.931584:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790391341.931765:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130797696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790391341.931826:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391341.931965:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130797696 00000100:00100000:2.0:1790391341.931971:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130797696 00000100:00100000:2.0:1790391341.932039:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391341.932047:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130797696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790391341.932177:0:8917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790391341.932179:0:8917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790391341 00002000:00010000:2.0:1790391341.932181:0:8917:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790391341.932183:0:8917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790391341 -> 1790391341 00002000:00010000:2.0:1790391341.932184:0:8917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790391341.932231:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1877361130797696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (404us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790391341.932237:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1790391341.932344:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1790391341.932371:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962411ad0000/2, rc 0, transno 4294967303 00000100:00100000:3.0:1790391341.932376:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130797696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790391341.934034:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:10473:x1877361108755584:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 Request processed in 94116us (94356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391341.934045:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 80 00000100:00100000:3.0:1790391341.938518:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.938830:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108755712 00000100:00100000:2.0:1790391341.938840:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108755712 00000100:00100000:2.0:1790391341.938933:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:2.0:1790391341.938944:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108755712:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1790391341.965715:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1790391341.965738:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1790391341.965962:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108755712:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 Request processed in 27014us (27448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391341.965973:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:1.0:1790391341.970483:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.970596:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108755968 00000100:00100000:3.0:1790391341.970615:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108755968 00000100:00100000:3.0:1790391341.970710:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 81 00000100:00100000:3.0:1790391341.970721:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:10473:x1877361108755968:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790391341.970854:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391341.970885:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449aca7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.970904:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391341.970909:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391341.970950:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.970964:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.970974:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391341.971326:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e6a3bcc reply state 0000000038f72995 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391341.971337:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391341.971454:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10473:x1877361108755968:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 734us (1060us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790391341.971478:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 81 00010000:00010000:3.0:1790391341.975105:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.975124:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.975131:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.975137:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391341.975141:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.975149:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.975167:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391341.975171:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391341.975176:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.975182:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449acbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391341.976010:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.976436:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108756096 00000100:00100000:2.0:1790391341.976447:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108756096 00000100:00100000:2.0:1790391341.976501:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:2.0:1790391341.976510:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108756096:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790391341.976760:0:8917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790391341.976763:0:8917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790391341 -> 1790391340 00002000:00010000:2.0:1790391341.976766:0:8917:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790391338 00002000:00010000:2.0:1790391341.976768:0:8917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790391341 -> 1790391340 00002000:00010000:2.0:1790391341.976771:0:8917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790391341.976833:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108756096:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 323us (828us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790391341.976841:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:0.0:1790391341.979324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.979494:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108756352 00000100:00100000:3.0:1790391341.979505:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108756352 00000100:00100000:3.0:1790391341.979573:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:3.0:1790391341.979584:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:10473:x1877361108756352:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790391341.979668:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.979697:0:11443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 13 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.979707:0:11443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.979744:0:11443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 13 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.979757:0:11443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 13 pid: 11443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391341.979770:0:11443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f564700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130797824:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391341.979873:0:11443:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a93540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391341.982469:0:11443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f564700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130797824:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391341.982499:0:11443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391341.983762:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391341.984114:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108756480 00000100:00100000:3.0:1790391341.984124:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108756480 00010000:00010000:3.0:1790391341.984166:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 14 pid: 11443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391341.984218:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:3.0:1790391341.984228:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:2364:x1877361108756480:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391341.984245:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391341.984253:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 14 pid: 11443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.984266:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 14 pid: 11443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.984305:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449ac84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd9b expref: 14 pid: 11443 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.984322:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:3.0:1790391341.984327:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.984336:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.984343:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391341.984379:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391341.984450:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2364:x1877361108756480:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 223us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391341.984459:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 43 00010000:00010000:0.0:1790391341.985910:0:11443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.985935:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.985963:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.985970:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.985977:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.985982:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391341.985986:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.985993:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.986006:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:0.0:1790391341.986055:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790391341.986061:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391341.986068:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449acc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391341.986149:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:10473:x1877361108756352:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 Request processed in 6563us (6830us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790391341.986158:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:0.0:1790391341.991872:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391341.991971:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108756608 00000100:00100000:1.0:1790391341.991983:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108756608 00000100:00100000:1.0:1790391341.992072:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391341.992097:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108756608:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790391341.992143:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.992163:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.992172:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391341.992176:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391341.992182:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.992228:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391341.992244:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 7 pid: 6694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391341.992259:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130797952:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391341.992352:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49e240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391341.998153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391341.998252:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108756736 00000100:00100000:2.0:1790391341.998263:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108756736 00010000:00010000:2.0:1790391341.998303:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 8 pid: 6694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391341.998367:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:2.0:1790391341.998378:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f566d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108756736:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391341.998393:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391341.998428:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 8 pid: 6694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.998442:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 8 pid: 6694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.998465:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391341.998470:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391341.998475:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.998485:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391341.998506:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391341.998556:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f566d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108756736:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 180us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391341.998564:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 44 00010000:00010000:1.0:1790391342.000367:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449acb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdb7 expref: 7 pid: 6694 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391342.000391:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130797952:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391342.000415:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000446:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000454:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000488:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000498:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000507:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000515:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391342.000520:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000529:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000549:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.000569:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a743331d/0x35e94fc15449acca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391342.000686:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2365:x1877361108756608:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 Request processed in 8590us (8823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391342.000696:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:3.0:1790391342.005416:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391342.005558:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108756992 00000100:00100000:0.0:1790391342.005569:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108756992 00000100:00100000:0.0:1790391342.005674:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 83 00000100:00100000:0.0:1790391342.005685:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:10473:x1877361108756992:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790391342.005768:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.005788:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.005800:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.006004:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.006050:0:8292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.006059:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.006108:0:8292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.006123:0:8292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 13 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391342.006139:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db87800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130798080:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391342.006233:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031feb40 going to sleep for 11 seconds 00000100:00080000:3.0:1790391342.006974:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391342.011746:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db87800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130798080:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391342.011784:0:8292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391342.014860:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391342.015242:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108757120 00000100:00100000:1.0:1790391342.015253:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108757120 00010000:00010000:1.0:1790391342.015297:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 14 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391342.015339:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:1.0:1790391342.015348:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:2364:x1877361108757120:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391342.015361:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391342.015368:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 14 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.015382:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 14 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.015412:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ac92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fda2 expref: 14 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.015429:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:1.0:1790391342.015434:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.015456:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.015464:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391342.015491:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391342.015545:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2364:x1877361108757120:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 197us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391342.015552:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 45 00010000:00010000:0.0:1790391342.015675:0:8292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.015683:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391342.015886:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1790391342.016101:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1790391342.016148:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1790391342.016230:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db87800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130798208:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790391342.016305:0:8292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391342.016332:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391342.016888:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130798208 00000100:00100000:3.0:1790391342.016896:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130798208 00000100:00100000:3.0:1790391342.016945:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391342.016954:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8292:x1877361130798208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790391342.017180:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8292:x1877361130798208:12345-0@lo:1000:mdt00_003.0 Request processed in 226us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391342.017187:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391342.019153:0:8292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1790391342.019165:0:8292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962411ad0000, transno 4294967303 00000100:00100000:2.0:1790391342.019237:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db87800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130798208:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1790391342.020763:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1790391342.020871:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130798336:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790391342.021139:0:8292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391342.021233:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff962403105a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391342.023877:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130798336 00000100:00100000:1.0:1790391342.023898:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130798336 00000100:00100000:1.0:1790391342.024415:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391342.024427:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8292:x1877361130798336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790391342.025072:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8292:x1877361130798336:12345-0@lo:1000:mdt00_003.0 Request processed in 646us (3932us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790391342.025082:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391342.025183:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130798336:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1790391342.025238:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025250:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025257:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025263:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391342.025268:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025276:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025293:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff962411373400) 00010000:00010000:2.0:1790391342.025297:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391342.025303:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025310:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449acd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025355:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025372:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025377:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025382:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391342.025386:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025392:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025413:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:2.0:1790391342.025416:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391342.025419:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025424:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ac0d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025471:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025486:0:8292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025495:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025527:0:8292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.025550:0:8292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 16 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391342.025564:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130798464:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391342.025670:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff962403105a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391342.031410:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391342.031535:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130798464:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391342.031564:0:8292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391342.032360:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108757248 00000100:00100000:0.0:1790391342.032371:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108757248 00010000:00010000:0.0:1790391342.032471:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 17 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391342.032570:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:0.0:1790391342.032689:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f565500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:2363:x1877361108757248:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391342.032707:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391342.032715:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 17 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.032729:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 17 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.032751:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ac29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fd86 expref: 17 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.032769:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:0.0:1790391342.032775:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.032784:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.032791:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391342.032869:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391342.033078:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f565500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:2363:x1877361108757248:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 497us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391342.033086:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 46 00010000:00010000:2.0:1790391342.033376:0:8292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033385:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033457:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033467:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033475:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033480:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391342.033484:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033491:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033515:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:2.0:1790391342.033517:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391342.033521:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033527:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449acdf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033537:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033543:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033548:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033552:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391342.033555:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033561:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033568:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:2.0:1790391342.033570:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391342.033573:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.033656:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449acd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391342.033945:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:10473:x1877361108756992:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 28261us (28548us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1790391342.033955:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 83 00000020:00080000:2.0:1790391342.033960:0:8292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1790391342.039926:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391342.040051:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108757504 00000100:00100000:2.0:1790391342.040062:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108757504 00000100:00100000:2.0:1790391342.040112:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:2.0:1790391342.040123:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:10473:x1877361108757504:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790391342.041039:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790391342.041157:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1790391342.042527:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.042552:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.042563:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.042572:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.042916:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.042923:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391342.042996:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790391342.043150:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:10473:x1877361108757504:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 3024us (3229us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1790391342.043160:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00000020:00080000:2.0:1790391342.043166:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1790391342.044267:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391342.044274:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391342.044306:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790391342.044312:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790391342.048594:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391342.048619:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391342.048631:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391342.048635:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391342.048646:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391342.048665:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:3.0:1790391342.048669:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790391342.048674:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391342.048680:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449ace6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391342.049062:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391342.049065:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391342.049067:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391342.425483:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391343.003641:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130798976:0@lo:400:kworker.0 00000100:00100000:3.0:1790391343.003716:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391343.003769:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790391343.003776:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130798592:0@lo:400:kworker.0 00000100:00100000:3.0:1790391343.003805:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391343.003827:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130799104:0@lo:400:kworker.0 00000100:00100000:3.0:1790391343.003849:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391343.003890:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130798720:0@lo:400:kworker.0 00000100:00100000:3.0:1790391343.003915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391343.003930:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130799232:0@lo:400:kworker.0 00000100:00100000:3.0:1790391343.003957:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391343.003973:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391343.003978:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130798848:0@lo:400:kworker.0 00000100:00100000:3.0:1790391343.004008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391343.004056:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130798976 00000100:00100000:3.0:1790391343.004063:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130798976 00000100:00100000:3.0:1790391343.004109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130799104 00000100:00100000:3.0:1790391343.004113:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130799104 00000100:00100000:3.0:1790391343.004130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130798720 00000100:00100000:3.0:1790391343.004133:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130798720 00000100:00100000:3.0:1790391343.004147:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790391343.004154:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130798976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391343.004205:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130798976:12345-0@lo:400:kworker.0 Request processed in 50us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391343.004212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790391343.004492:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790391343.004500:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130799104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391343.004533:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130799104:12345-0@lo:400:kworker.0 Request processed in 34us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391343.004538:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790391343.004552:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790391343.004557:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130798720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391343.004593:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130798720:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391343.004599:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790391343.004634:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130798720:0@lo:400:kworker.0 00000100:00100000:0.0:1790391343.004659:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391343.004668:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130799360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391343.004693:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391343.004720:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130799360 00000100:00100000:0.0:1790391343.004724:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130799360 00000100:00100000:0.0:1790391343.004753:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391343.004759:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130799360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391343.004786:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391343.004820:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130799360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391343.004832:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130799232 00000100:00100000:0.0:1790391343.004835:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790391343.004836:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130799232 00000100:00100000:2.0:1790391343.004860:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130798848 00000100:00100000:2.0:1790391343.004863:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130798848 00000100:00100000:0.0:1790391343.004864:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130799360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391343.004883:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790391343.004889:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130799232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391343.004904:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391343.004910:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130798848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391343.004926:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130799232:12345-0@lo:400:kworker.0 Request processed in 38us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391343.004932:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790391343.004934:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130798848:12345-0@lo:400:kworker.0 Request processed in 26us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391343.004939:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790391343.004956:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130798848:0@lo:400:kworker.0 00000100:00100000:2.0:1790391343.004966:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130799232:0@lo:400:kworker.0 00000100:00080000:0.0:1790391343.004984:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391343.004988:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391343.004991:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391343.005004:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130798592 00000100:00100000:0.0:1790391343.005008:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130798592 00000100:00100000:0.0:1790391343.005060:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790391343.005066:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130798592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391343.005097:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130798592:12345-0@lo:400:kworker.0 Request processed in 31us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391343.005103:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790391343.005133:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130798592:0@lo:400:kworker.0 00000100:00100000:0.0:1790391343.005147:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130799104:0@lo:400:kworker.0 00000100:00100000:0.0:1790391343.005156:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130798976:0@lo:400:kworker.0 00000100:00100000:1.0:1790391343.371342:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391343.371398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391343.371428:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391343.371449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391343.371471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391343.371499:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108758016 00000100:00100000:1.0:1790391343.371508:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108758016 00000100:00100000:1.0:1790391343.371562:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108757888 00000100:00100000:1.0:1790391343.371565:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108757888 00000100:00100000:1.0:1790391343.371598:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:1.0:1790391343.371610:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108758016:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391343.371690:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108758016:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391343.371698:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:1.0:1790391343.371715:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:1.0:1790391343.371723:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108757888:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391343.371747:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108757888:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391343.371753:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:1.0:1790391343.371773:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108757632 00000100:00100000:1.0:1790391343.371776:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108757632 00000100:00100000:1.0:1790391343.371802:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 287 00000100:00100000:1.0:1790391343.371809:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108757632:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391343.371835:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108757632:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391343.371841:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 287 00000100:00100000:1.0:1790391343.371866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108757760 00000100:00100000:1.0:1790391343.371870:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108757760 00000100:00100000:1.0:1790391343.371890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108758144 00000100:00100000:1.0:1790391343.371893:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108758144 00000100:00100000:1.0:1790391343.371912:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 137 00000100:00100000:1.0:1790391343.371918:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:2363:x1877361108757760:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391343.371947:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:2363:x1877361108757760:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391343.371954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 137 00000100:00100000:1.0:1790391343.371964:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 138 00000100:00100000:1.0:1790391343.371977:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108758144:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391343.371999:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108758144:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391343.372005:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 138 00000100:00080000:0.0:1790391343.372254:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391343.372260:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391343.372262:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790391343.450308:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391343.906812:0:12064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790391343.906821:0:12064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790391343.906856:0:12064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790391343.906877:0:12064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391344.047358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.047429:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108758400 00000100:00100000:1.0:1790391344.047439:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108758400 00000100:00100000:1.0:1790391344.047524:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 84 00000100:00100000:1.0:1790391344.047537:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:10492:x1877361108758400:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391344.047557:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391344.047588:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdbe expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.047695:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449acf4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.047710:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449acf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.047724:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449acf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391344.047734:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790391344.047858:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdbe expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.047877:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449acf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdbe expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.047885:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391344.047901:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391344.047906:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30400, rc 0) 00000100:00100000:1.0:1790391344.047971:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10492:x1877361108758400:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 437us (625us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790391344.047978:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 84 00000100:00080000:2.0:1790391344.048112:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391344.053406:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.053476:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108758528 00000100:00100000:1.0:1790391344.053485:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108758528 00000100:00100000:1.0:1790391344.053543:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 85 00000100:00100000:1.0:1790391344.053554:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10492:x1877361108758528:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:1.0:1790391344.053649:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053668:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053680:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053696:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053702:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053709:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053950:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053959:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.053972:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391344.054043:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054057:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054064:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054072:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054078:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.054083:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054091:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054102:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391344.054105:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391344.054110:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054116:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449ad02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054126:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054136:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054142:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054146:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.054149:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054155:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054162:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9624119e7700) 00010000:00010000:1.0:1790391344.054164:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391344.054167:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054172:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054185:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054191:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054196:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054201:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.054210:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054216:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054223:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9624119e7e00) 00010000:00010000:1.0:1790391344.054226:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391344.054228:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.054234:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.054320:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10492:x1877361108758528:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 767us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391344.054328:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 85 00000100:00100000:1.0:1790391344.154275:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391344.157719:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108758784 00000100:00100000:3.0:1790391344.157736:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108758784 00000100:00100000:2.0:1790391344.158492:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 86 00000100:00100000:2.0:1790391344.158504:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10495:x1877361108758784:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391344.158523:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391344.158546:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ad17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdc5 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158630:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158644:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158675:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158692:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158702:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158709:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158987:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.158996:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159003:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391344.159033:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790391344.159140:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159148:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159154:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159160:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391344.159171:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159179:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159191:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391344.159194:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391344.159199:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159206:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449ad1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159216:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159223:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159228:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159233:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391344.159236:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159242:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159250:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96240bf85400) 00010000:00010000:2.0:1790391344.159252:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391344.159262:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159268:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ad25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159311:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ad17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 22 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159326:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 21 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.159334:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:2.0:1790391344.159337:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391344.159339:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10a00, rc 0) 00000100:00100000:2.0:1790391344.159407:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10495:x1877361108758784:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 905us (5142us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1790391344.159415:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 86 00000100:00100000:3.0:1790391344.167369:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.167460:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108758912 00000100:00100000:1.0:1790391344.167470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108758912 00000100:00100000:1.0:1790391344.167527:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 87 00000100:00100000:1.0:1790391344.167538:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10495:x1877361108758912:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:1.0:1790391344.167612:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167629:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167640:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167688:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167695:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167701:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167707:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.167712:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167721:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167733:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:1.0:1790391344.167736:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391344.167741:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.167748:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ad3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.167824:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10495:x1877361108758912:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 288us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391344.167832:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 87 00000100:00100000:0.0:1790391344.173759:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391344.173957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108759168 00000100:00100000:3.0:1790391344.173966:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108759168 00000100:00100000:3.0:1790391344.174058:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:3.0:1790391344.174068:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10495:x1877361108759168:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391344.174313:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:10495:x1877361108759168:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 245us (562us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790391344.174321:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:3.0:1790391344.213961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.214084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108759424 00000100:00100000:0.0:1790391344.214094:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108759424 00000100:00100000:0.0:1790391344.214157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00100000:0.0:1790391344.214168:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:10015:x1877361108759424:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:0.0:1790391344.214192:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391344.214213:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ad41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdcc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.214321:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.214336:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 23 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.214346:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.214385:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 23 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.214400:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 23 pid: 11443 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391344.214413:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db84380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130799488:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391344.214515:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391344.216357:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db84380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130799488:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391344.216396:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391344.218853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.219295:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108759552 00000100:00100000:2.0:1790391344.219306:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108759552 00010000:00010000:2.0:1790391344.219351:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 24 pid: 11443 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.219437:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:2.0:1790391344.219448:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:2363:x1877361108759552:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391344.219479:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391344.219487:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 24 pid: 11443 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.219500:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 24 pid: 11443 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.219522:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdc5 expref: 24 pid: 11443 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.219539:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:2.0:1790391344.219543:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.219553:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.219560:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.219606:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391344.219665:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:2363:x1877361108759552:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 218us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391344.219672:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00010000:00010000:0.0:1790391344.221310:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.221325:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391344.221380:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790391344.221555:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ad41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.221595:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.221604:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:0.0:1790391344.221607:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391344.221611:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031a00, rc 0) 00000100:00100000:0.0:1790391344.221678:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:10015:x1877361108759424:12345-192.168.201.8@tcp:101:bash.0 Request processed in 7511us (7728us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790391344.221688:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00100000:3.0:1790391344.232002:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.232699:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108759808 00000100:00100000:1.0:1790391344.232712:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108759808 00000100:00100000:1.0:1790391344.232775:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 89 00000100:00100000:1.0:1790391344.232799:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:10015:x1877361108759808:12345-192.168.201.8@tcp:36:bash.0 00010000:00010000:1.0:1790391344.233080:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.233097:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.233108:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391344.233159:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1790391344.233181:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2d2b9a7 reply state 000000007ccb33f5 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.233191:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790391344.233264:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1790391344.233500:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10015:x1877361108759808:12345-192.168.201.8@tcp:36:bash.0 Request processed in 701us (1506us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1790391344.233507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 89 00000020:00080000:1.0:1790391344.233511:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1790391344.235885:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.235902:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.235909:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.235915:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391344.235919:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.235926:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.235944:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:3.0:1790391344.235947:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391344.235952:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.235959:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ad56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.236962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.237050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108759936 00000100:00100000:2.0:1790391344.237058:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108759936 00000100:00100000:2.0:1790391344.237106:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 90 00000100:00100000:2.0:1790391344.237117:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10015:x1877361108759936:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391344.237150:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391344.237171:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdd3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.237217:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdd3 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.237226:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdd3 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.237239:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:2.0:1790391344.237241:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391344.237243:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10a00, rc 0) 00000100:00100000:2.0:1790391344.237287:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10015:x1877361108759936:12345-192.168.201.8@tcp:101:bash.0 Request processed in 173us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391344.237291:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 90 00000100:00100000:0.0:1790391344.240391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.241528:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108760064 00000100:00100000:1.0:1790391344.241543:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108760064 00000100:00100000:1.0:1790391344.241623:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:1.0:1790391344.241633:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:10015:x1877361108760064:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391344.241651:0:8917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391344.241671:0:8917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdda expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391344.241698:0:8917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab7342c, atime: 0x6ab7342a, ctime: 0x6ab7342c, blocks: 0xb 00010000:00010000:1.0:1790391344.241736:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1790391344.241740:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391344.241748:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 7 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.241768:0:8917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 7 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.241781:0:8917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31c00, rc 0) 00000100:00100000:1.0:1790391344.241847:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:10015:x1877361108760064:12345-192.168.201.8@tcp:101:bash.0 Request processed in 215us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391344.241855:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:3.0:1790391344.245004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.245180:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108760192 00000100:00100000:1.0:1790391344.245189:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108760192 00002000:00010000:1.0:1790391344.245228:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1790391344.245232:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399bd880 with x1877361108760192 ext(0->18446744073709551615) 00002000:00010000:1.0:1790391344.245243:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624399bd880. 00000100:00100000:1.0:1790391344.245274:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:1.0:1790391344.245282:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108760192:12345-192.168.201.8@tcp:10:bash.0 00002000:00010000:1.0:1790391344.245577:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790391344.245581:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790391340 -> 1790391343 00002000:00010000:1.0:1790391344.245584:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790391338 -> 1790391338 00002000:00010000:1.0:1790391344.245586:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790391340 -> 1790391343 00002000:00010000:1.0:1790391344.245589:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790391344.245831:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108760192:12345-192.168.201.8@tcp:10:bash.0 Request processed in 547us (834us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790391344.245855:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00002000:00010000:1.0:1790391344.245859:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1790391344.245862:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399bd880 with x1877361108760192 ext(0->18446744073709551615) 00002000:00010000:1.0:1790391344.245867:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624399bd880. 00000100:00100000:3.0:1790391344.314476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.314529:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108760320 00000100:00100000:0.0:1790391344.314540:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108760320 00000100:00100000:0.0:1790391344.314668:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 91 00000100:00100000:0.0:1790391344.314680:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10509:x1877361108760320:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:0.0:1790391344.314754:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.314773:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.314786:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.314804:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.314827:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.314835:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315117:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315128:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315136:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391344.315177:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315190:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315197:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315204:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315211:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.315216:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315224:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315242:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391344.315245:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.315252:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315259:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315271:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315278:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315284:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315290:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.315293:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315300:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315307:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962430751100) 00010000:00010000:0.0:1790391344.315310:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.315312:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315318:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315343:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315350:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315357:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315362:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400030400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.315365:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315371:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315378:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:0.0:1790391344.315381:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.315383:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.315389:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391344.315469:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10509:x1877361108760320:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 790us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391344.315477:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 91 00000100:00100000:0.0:1790391344.365138:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.365295:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108760576 00000100:00100000:1.0:1790391344.365306:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108760576 00000100:00100000:0.0:1790391344.365453:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00100000:0.0:1790391344.365465:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:10512:x1877361108760576:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391344.365505:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391344.365526:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fde1 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365614:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365629:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365640:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365655:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365662:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365668:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365913:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ad95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365922:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ad95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.365928:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ad95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391344.365938:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790391344.366475:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366485:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366490:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366496:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.366500:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366508:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366521:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391344.366524:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.366529:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366536:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449ad87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366549:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366555:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366573:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366588:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.366592:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366598:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366606:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962430751100) 00010000:00010000:0.0:1790391344.366609:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.366612:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366619:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449ad8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366661:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449ad80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fde1 expref: 30 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366676:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ad95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fde1 expref: 29 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.366683:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:0.0:1790391344.366685:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790391344.366687:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031800, rc 0) 00000100:00100000:0.0:1790391344.366757:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10512:x1877361108760576:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1294us (1630us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1790391344.366766:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00100000:1.0:1790391344.371622:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.371708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108760704 00000100:00100000:2.0:1790391344.371717:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108760704 00000100:00100000:2.0:1790391344.371777:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 93 00000100:00100000:2.0:1790391344.371787:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10512:x1877361108760704:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:2.0:1790391344.371852:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.371868:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.371878:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.371927:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.371939:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 29 pid: 5838 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.371954:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130799616:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391344.372075:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391344.375530:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130799616:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391344.375572:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.376621:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391344.376815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108760960 00000100:00100000:3.0:1790391344.376824:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108760960 00000100:00100000:3.0:1790391344.376880:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:3.0:1790391344.376889:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:5602:x1877361108760960:12345-192.168.201.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790391344.377224:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:5602:x1877361108760960:12345-192.168.201.8@tcp:35:ldlm_bl.0 Request processed in 335us (608us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1790391344.377232:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:3.0:1790391344.379114:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.379207:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108761088 00000100:00100000:0.0:1790391344.379229:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108761088 00010000:00010000:0.0:1790391344.379260:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 31 pid: 5838 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391344.379297:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1790391344.379306:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:2363:x1877361108761088:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391344.379319:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391344.379326:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 31 pid: 5838 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.379339:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 31 pid: 5838 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.379367:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031a00/0x35e94fc15449ad48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdcc expref: 31 pid: 5838 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.379392:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:0.0:1790391344.379398:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.379408:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.379415:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.379447:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391344.379494:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:2363:x1877361108761088:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 188us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391344.379512:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00010000:00010000:2.0:1790391344.379588:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379596:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379625:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379633:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379640:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379645:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391344.379650:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379663:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379672:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:2.0:1790391344.379675:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391344.379679:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.379685:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ada3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.379724:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10512:x1877361108760704:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 7939us (8111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391344.379733:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 93 00000100:00100000:0.0:1790391344.382475:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391344.382558:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108761344 00000100:00100000:3.0:1790391344.382576:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108761344 00000100:00100000:3.0:1790391344.382631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:3.0:1790391344.382641:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:10512:x1877361108761344:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391344.382866:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10512:x1877361108761344:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 225us (398us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790391344.382873:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:3.0:1790391344.403124:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.403203:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108761472 00000100:00100000:0.0:1790391344.403211:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108761472 00002000:00100000:0.0:1790391344.403254:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9624399bc380 x1877361108761472/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:210/0 lens 496/0 e 0 to 0 dl 1790391355 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391344.403265:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399bc380 with x1877361108761472 ext(0->7) 00002000:00010000:0.0:1790391344.403270:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624399bc380 00000100:00100000:0.0:1790391344.403298:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:0.0:1790391344.403307:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108761472:12345-192.168.201.8@tcp:4:bash.0 00000100:00100000:0.0:1790391344.403779:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2364:x1877361108761472:12345-192.168.201.8@tcp:4:bash.0 Request processed in 470us (661us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790391344.403787:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00002000:00100000:0.0:1790391344.403794:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9624399bc380 x1877361108761472/t4294967307(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:210/0 lens 496/448 e 0 to 0 dl 1790391355 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391344.403802:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399bc380 with x1877361108761472 ext(0->7) 00002000:00010000:0.0:1790391344.403806:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9624399bc380 00000100:00100000:1.0:1790391344.411973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.412072:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108761600 00000100:00100000:0.0:1790391344.412084:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108761600 00000100:00100000:0.0:1790391344.412391:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:0.0:1790391344.412403:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2363:x1877361108761600:12345-192.168.201.8@tcp:16:kworker.0 00000100:00100000:2.0:1790391344.466724:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2363:x1877361108761600:12345-192.168.201.8@tcp:16:kworker.0 Request processed in 54305us (54743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391344.466738:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00000001:00080000:1.0:1790391344.471241:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1790391344.471274:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:0.0:1790391344.473771:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391344.477750:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.478681:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108761856 00000100:00100000:0.0:1790391344.478692:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108761856 00000100:00100000:0.0:1790391344.478873:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 94 00000100:00100000:0.0:1790391344.478884:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+30:10523:x1877361108761856:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:0.0:1790391344.478910:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391344.478941:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449adaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fde8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479076:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479091:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479103:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479119:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479126:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479133:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479500:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449adbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479511:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449adbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479520:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449adbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391344.479543:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1790391344.479660:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479669:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479676:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479684:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.479690:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.479699:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480342:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391344.480346:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.480352:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480358:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449adb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480374:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480381:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480401:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480407:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.480411:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480418:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480426:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962430751a00) 00010000:00010000:0.0:1790391344.480429:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.480431:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480437:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979200/0x35e94fc15449adb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480496:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449adaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fde8 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480511:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449adbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fde8 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.480519:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:0.0:1790391344.480521:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391344.480524:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978c00, rc 0) 00000100:00100000:0.0:1790391344.480611:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10523:x1877361108761856:12345-192.168.201.8@tcp:101:cat.0 Request processed in 1729us (2872us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1790391344.480628:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 94 00000100:00100000:0.0:1790391344.485084:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391344.485311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108762112 00000100:00100000:3.0:1790391344.485323:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108762112 00000100:00100000:3.0:1790391344.485382:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:3.0:1790391344.485393:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10523:x1877361108762112:12345-192.168.201.8@tcp:35:cat.0 00000100:00100000:3.0:1790391344.485647:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10523:x1877361108762112:12345-192.168.201.8@tcp:35:cat.0 Request processed in 256us (575us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790391344.485670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:1.0:1790391344.503549:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391344.503694:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108762368 00000100:00100000:3.0:1790391344.503704:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108762368 00000100:00100000:3.0:1790391344.503752:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 95 00000100:00100000:3.0:1790391344.503759:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10524:x1877361108762368:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:3.0:1790391344.503808:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790391344.503828:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449adbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fde8 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503845:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031800/0x35e94fc15449ad95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fde1 expref: 32 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503853:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449ad5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdd3 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503860:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85900) 00010000:00010000:3.0:1790391344.503869:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391344.503886:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503896:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503902:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503910:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503944:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.503951:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.504453:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.504463:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.504471:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391344.505003:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1790391344.505047:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379839031234ns, next at 380838994759ns, rc = 0 00010000:00010000:2.0:1790391344.505093:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505104:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505110:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505115:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505119:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505122:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505135:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391344.505150:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505153:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505157:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505160:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391344.505164:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505171:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505190:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:2.0:1790391344.505193:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790391344.505197:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505203:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449addb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505219:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505224:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505228:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505231:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391344.505233:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505236:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505241:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391344.505243:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391344.505245:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.505248:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449adcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391344.505262:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c79dccfe reply state 00000000b231286f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.505268:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391344.505460:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:10524:x1877361108762368:12345-192.168.201.8@tcp:36:rm.0 Request processed in 1698us (1917us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1790391344.505468:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 95 00010000:00010000:3.0:1790391344.505627:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391344.505633:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.505640:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391344.505643:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.505650:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.505658:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96240bf85400) 00010000:00010000:3.0:1790391344.505661:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790391344.505664:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.505670:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449ade2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.505686:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391344.505688:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391344.505689:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391344.507799:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.507834:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.507842:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.507847:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391344.507852:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.507859:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.507876:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962411373c00) 00010000:00010000:3.0:1790391344.507879:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391344.507883:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.507889:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449add4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391344.554614:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.554693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108762624 00000100:00100000:2.0:1790391344.554701:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108762624 00000100:00100000:2.0:1790391344.554745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 96 00000100:00100000:2.0:1790391344.554753:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:10530:x1877361108762624:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391344.554773:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391344.554793:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ade9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.554902:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.554914:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.554925:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.554939:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.554946:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.554969:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391344.555444:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1790391344.555608:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555620:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555627:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555660:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555667:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555674:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555680:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391344.555684:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555691:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555705:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391344.555709:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391344.555724:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555732:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449adf0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391344.555746:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008804db12 reply state 00000000e8b0fd99 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.555757:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790391344.555788:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449ade9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555802:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.555810:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96240bf85a00) 00010000:00010000:2.0:1790391344.555812:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391344.555814:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10200, rc 0) 00000100:00100000:2.0:1790391344.556208:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:10530:x1877361108762624:12345-192.168.201.8@tcp:101:bash.0 Request processed in 1452us (1602us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1790391344.556217:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 96 00010000:00010000:3.0:1790391344.563384:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.563403:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.563411:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.563433:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391344.563438:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.563451:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.563470:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96240bf85400) 00010000:00010000:3.0:1790391344.563473:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391344.563479:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.563485:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449adf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391344.563690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.563764:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108762752 00000100:00100000:1.0:1790391344.563772:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108762752 00000100:00100000:1.0:1790391344.563827:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:1.0:1790391344.563838:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108762752:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391344.563854:0:8917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391344.563882:0:8917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdf6 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391344.563906:0:8917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391344.563920:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1790391344.563923:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391344.563930:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 8 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.563956:0:8917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 8 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.563965:0:8917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31600, rc 0) 00000100:00100000:1.0:1790391344.564031:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2365:x1877361108762752:12345-192.168.201.8@tcp:101:bash.0 Request processed in 178us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391344.564039:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:1.0:1790391344.566508:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391344.566650:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108762880 00000100:00100000:3.0:1790391344.566663:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108762880 00000100:00100000:3.0:1790391344.566718:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:3.0:1790391344.566726:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:10530:x1877361108762880:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:3.0:1790391344.566744:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391344.566761:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fdfd expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.566792:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 9 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.566801:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391344.566818:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391344.566824:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.566859:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 9 pid: 8917 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.567347:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 9 pid: 8917 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391344.567462:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9624399bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1877361130799744:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391344.567550:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391344.572508:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9624399bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1877361130799744:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391344.572517:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:3.0:1790391344.572545:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.572575:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3800, rc 0) 00000100:00100000:3.0:1790391344.572634:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10530:x1877361108762880:12345-192.168.201.8@tcp:101:bash.0 Request processed in 5907us (6137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391344.572643:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:2.0:1790391344.572726:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108763008 00000100:00100000:2.0:1790391344.572733:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108763008 00010000:00010000:2.0:1790391344.572763:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 9 pid: 8917 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.572795:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:2.0:1790391344.572804:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411b09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108763008:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391344.572830:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391344.572852:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 9 pid: 8917 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.572865:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 9 pid: 8917 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.572900:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe716ef9/0x35e94fc15449ae0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdf6 expref: 9 pid: 8917 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.572913:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391344.572917:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391344.572926:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.572936:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.572970:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.572983:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1877361130799872:192.168.201.8@tcp:105: 00000100:00100000:2.0:1790391344.573060:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391344.576008:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1877361130799872:192.168.201.8@tcp:105: 00010000:00010000:3.0:1790391344.576407:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391344.579863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.579968:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108763264 00000100:00100000:1.0:1790391344.579979:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108763264 00000100:00100000:1.0:1790391344.580049:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:1.0:1790391344.580060:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:10530:x1877361108763264:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:3.0:1790391344.580155:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411b09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108763008:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 7350us (7636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391344.580165:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:1.0:1790391344.580439:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:10530:x1877361108763264:12345-192.168.201.8@tcp:35:bash.0 Request processed in 380us (585us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1790391344.580446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 25 00000001:00080000:1.0:1790391344.583306:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1790391344.583464:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1790391344.726292:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.726709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108763392 00000100:00100000:0.0:1790391344.726721:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108763392 00000100:00100000:0.0:1790391344.726853:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 97 00000100:00100000:0.0:1790391344.726865:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:10546:x1877361108763392:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391344.726891:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391344.726931:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.727009:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449ae21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.727085:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.727101:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391344.727141:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790391344.727144:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391344.727164:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449ae21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.727191:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe04 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.727212:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449ae21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe04 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.727236:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391344.727239:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391344.727243:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979e00, rc 0) 00000100:00100000:0.0:1790391344.727318:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:10546:x1877361108763392:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 454us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391344.727324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 97 00000100:00100000:3.0:1790391344.734502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.735861:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108763648 00000100:00100000:1.0:1790391344.735874:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108763648 00000100:00100000:0.0:1790391344.736069:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 98 00000100:00100000:0.0:1790391344.736092:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:10546:x1877361108763648:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391344.736114:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391344.736134:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449ae28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe0b expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.736295:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449ae2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.736307:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449ae2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.736316:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449ae2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391344.736324:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790391344.736453:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449ae28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe0b expref: 38 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.736471:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449ae2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe0b expref: 37 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.736497:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96240bf85a00) 00010000:00010000:0.0:1790391344.736499:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391344.736502:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979400, rc 0) 00000100:00100000:0.0:1790391344.736769:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:10546:x1877361108763648:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 690us (2284us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1790391344.736778:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 98 00000100:00100000:3.0:1790391344.740646:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.740708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108763904 00000100:00100000:2.0:1790391344.740735:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108763904 00000100:00100000:2.0:1790391344.740872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 99 00000100:00100000:2.0:1790391344.740883:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:10546:x1877361108763904:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391344.740909:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391344.741110:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe12 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.741216:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ae44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.741232:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ae44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.741244:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ae44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391344.741258:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:3.0:1790391344.741391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:2.0:1790391344.741394:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe12 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.741412:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ae44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe12 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.741422:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96240bf85a00) 00010000:00010000:2.0:1790391344.741425:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790391344.741593:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11a00, rc 0) 00000100:00100000:0.0:1790391344.741644:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108764032 00000100:00100000:0.0:1790391344.741650:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108764032 00000100:00100000:2.0:1790391344.741655:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:10546:x1877361108763904:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 773us (1021us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1790391344.741663:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 99 00000100:00100000:0.0:1790391344.741690:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:0.0:1790391344.741698:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+39:2363:x1877361108764032:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391344.741707:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391344.741724:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449ae2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe0b expref: 39 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.741735:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96240bf85a00) 00010000:00010000:0.0:1790391344.741739:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391344.741760:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+38:2363:x1877361108764032:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 63us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391344.741766:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:3.0:1790391344.759342:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.759573:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108764160 00000100:00100000:1.0:1790391344.759584:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108764160 00000100:00100000:1.0:1790391344.759654:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:1.0:1790391344.759665:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108764160:12345-192.168.201.8@tcp:1:lfs.0 00010000:00010000:1.0:1790391344.759718:0:8917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.759756:0:8917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.759765:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790391344.759769:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391344.759774:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.759816:0:8917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.759832:0:8917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 6 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.759847:0:8917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8917:1877361130800000:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391344.760161:0:8917:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391344.762345:0:8917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8917:1877361130800000:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391344.762389:0:8917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391344.763847:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.763917:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108764288 00000100:00100000:1.0:1790391344.763928:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108764288 00002000:00100000:1.0:1790391344.763982:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9624399bd500 x1877361108764288/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:210/0 lens 504/0 e 0 to 0 dl 1790391355 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391344.764012:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399bd500 with x1877361108764288 ext(0->8) 00010000:00010000:1.0:1790391344.764053:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 7 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.764070:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 7 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391344.764079:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9624399bd500 00000100:00100000:1.0:1790391344.764127:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:1.0:1790391344.764138:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108764288:12345-192.168.201.8@tcp:4:lfs.0 00000100:00100000:1.0:1790391344.765114:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2363:x1877361108764288:12345-192.168.201.8@tcp:4:lfs.0 Request processed in 974us (1269us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790391344.765125:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00002000:00100000:1.0:1790391344.765134:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9624399bd500 x1877361108764288/t4294967302(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:210/0 lens 504/448 e 0 to 0 dl 1790391355 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391344.765143:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399bd500 with x1877361108764288 ext(0->8) 00010000:00010000:1.0:1790391344.765151:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.765166:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391344.765173:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9624399bd500 00000100:00100000:3.0:1790391344.767069:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.767134:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108764416 00000100:00100000:2.0:1790391344.767143:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108764416 00010000:00010000:2.0:1790391344.767190:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.767231:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:2.0:1790391344.767242:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2366:x1877361108764416:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391344.767257:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790391344.767276:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790391344.767279:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790391344 00002000:00010000:2.0:1790391344.767282:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790391344 00002000:00010000:2.0:1790391344.767284:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790391344 00010000:00010000:2.0:1790391344.767290:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.767303:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.767328:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449ae13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdfd expref: 9 pid: 6697 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.767359:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391344.767363:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391344.767369:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.767379:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.767430:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391344.767570:0:8917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.767581:0:8917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.767606:0:8917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.767614:0:8917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.767623:0:8917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.767630:0:8917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391344.767634:0:8917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.767643:0:8917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.767643:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2366:x1877361108764416:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 403us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391344.767652:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00010000:00010000:3.0:1790391344.767668:0:8917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391344.767676:0:8917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004360f057/0x35e94fc15449ae52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391344.767725:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108764160:12345-192.168.201.8@tcp:1:lfs.0 Request processed in 8062us (8390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391344.767732:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:3.0:1790391344.774144:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.774198:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108764672 00000100:00100000:2.0:1790391344.774208:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108764672 00000100:00100000:2.0:1790391344.774272:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:2.0:1790391344.774283:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+38:10546:x1877361108764672:12345-192.168.201.8@tcp:35:lfs.0 00000004:00010000:2.0:1790391344.774351:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ae44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe12 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391344.774676:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1790391344.774719:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1790391344.775425:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1790391344.775490:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.775574:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.775585:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.775624:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.775641:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 42 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391344.775667:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1877361130800128:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391344.775792:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391344.780258:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.780827:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1877361130800128:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391344.781101:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.781571:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108764800 00000100:00100000:1.0:1790391344.781592:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108764800 00010000:00010000:1.0:1790391344.781626:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 43 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.781661:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:1.0:1790391344.781670:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+43:2363:x1877361108764800:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391344.781684:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391344.781692:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 43 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.781704:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 43 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.781722:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449adfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdef expref: 43 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.781735:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96240bf85a00) 00010000:00010000:1.0:1790391344.781738:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.781744:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.781750:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.781778:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391344.781795:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391344.781802:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.781841:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+42:2363:x1877361108764800:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 171us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391344.781856:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 51 00000001:00080000:2.0:1790391344.782296:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1790391344.782518:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1790391344.782639:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130800256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790391344.782687:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391344.782821:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a239c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391344.784156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130800256 00000100:00100000:3.0:1790391344.784169:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130800256 00000100:00100000:2.0:1790391344.784310:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391344.784320:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877361130800256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790391344.784658:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877361130800256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 338us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391344.784666:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391344.784999:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1790391344.785007:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1790391344.785098:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962439b77480, transno 4294967301 00000100:00100000:0.0:1790391344.785151:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130800256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790391344.786264:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1790391344.786336:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130800384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790391344.786635:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391344.786665:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391344.786686:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130800384 00000100:00100000:0.0:1790391344.786701:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130800384 00000100:00100000:0.0:1790391344.786759:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391344.786769:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1877361130800384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790391344.787212:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1877361130800384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 443us (576us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790391344.787221:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391344.787282:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130800384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790391344.789001:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1790391344.789658:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.789672:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.789679:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.789686:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.789691:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.789700:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.789717:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96240bf85a00) 00010000:00010000:1.0:1790391344.789720:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790391344.789726:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.789733:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449ae59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790391344.792691:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790391344.792883:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1790391344.792897:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380126880632ns, next at 381126877804ns, rc = 0 00000001:00080000:1.0:1790391344.792907:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1790391344.792961:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96240bf85a00) 00010000:00010000:1.0:1790391344.792965:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790391344.792976:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449ae44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe12 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.793142:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+45:10546:x1877361108764672:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 18860us (19008us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1790391344.793151:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 26 00000020:00080000:1.0:1790391344.793157:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790391344.797048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.797297:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108764928 00000100:00100000:0.0:1790391344.797307:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108764928 00000100:00100000:0.0:1790391344.797360:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 100 00000100:00100000:0.0:1790391344.797379:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+45:10546:x1877361108764928:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391344.797403:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391344.797426:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449ae60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe19 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.797503:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449ae60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe19 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.797520:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449ae60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe19 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.797539:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391344.797543:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391344.797546:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978600, rc 0) 00000100:00100000:0.0:1790391344.797614:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+46:10546:x1877361108764928:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 245us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391344.797621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 100 00000100:00100000:3.0:1790391344.801919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.802050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108765184 00000100:00100000:1.0:1790391344.802060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108765184 00000100:00100000:1.0:1790391344.802114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:1.0:1790391344.802124:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+46:10546:x1877361108765184:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:1.0:1790391344.802339:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+47:10546:x1877361108765184:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 217us (432us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1790391344.802350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:3.0:1790391344.894630:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391344.894824:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108765312 00000100:00100000:0.0:1790391344.894841:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108765312 00000100:00100000:0.0:1790391344.895115:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 101 00000100:00100000:0.0:1790391344.895127:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+47:10556:x1877361108765312:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:0.0:1790391344.895215:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895233:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895244:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895258:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895265:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895271:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895358:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895367:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895374:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391344.895414:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895437:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895443:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895449:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895455:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.895458:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895465:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895476:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391344.895479:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.895484:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895490:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449ae67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895514:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895521:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895526:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895545:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.895548:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895563:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895571:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff962430751a00) 00010000:00010000:0.0:1790391344.895574:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.895577:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895583:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449ae6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895599:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895604:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895609:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895613:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391344.895616:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895621:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895638:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391344.895639:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391344.895642:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391344.895648:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449ae75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391344.895723:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+47:10556:x1877361108765312:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 599us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391344.895730:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 101 00000100:00100000:3.0:1790391344.946976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.947276:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108765568 00000100:00100000:1.0:1790391344.947288:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108765568 00000100:00100000:1.0:1790391344.947354:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 102 00000100:00100000:1.0:1790391344.947372:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+47:10559:x1877361108765568:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391344.947393:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391344.947429:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ae7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe20 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947538:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947563:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947575:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947591:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947599:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947606:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947724:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ae91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947734:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ae91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947741:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ae91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391344.947752:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790391344.947859:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947889:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947896:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947902:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.947906:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947913:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947939:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391344.947942:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391344.947948:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947953:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947967:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947973:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947978:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947982:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.947991:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.947998:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.948005:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9624119e7000) 00010000:00010000:1.0:1790391344.948007:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391344.948010:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.948082:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449ae8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.948124:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449ae7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe20 expref: 50 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.948139:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ae91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe20 expref: 49 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.948146:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:1.0:1790391344.948149:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391344.948151:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31e00, rc 0) 00000100:00100000:1.0:1790391344.948693:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+49:10559:x1877361108765568:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1318us (1725us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1790391344.948704:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 102 00000100:00100000:3.0:1790391344.954330:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391344.954427:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108765696 00000100:00100000:1.0:1790391344.954437:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108765696 00000100:00100000:1.0:1790391344.954517:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 103 00000100:00100000:1.0:1790391344.954529:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+49:10559:x1877361108765696:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:1.0:1790391344.954643:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954662:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954674:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954706:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954714:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954721:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954727:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391344.954731:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954739:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954750:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:1.0:1790391344.954753:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391344.954757:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391344.954764:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449ae9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391344.954871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+49:10559:x1877361108765696:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 337us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391344.954880:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 103 00000100:00100000:3.0:1790391344.961306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391344.961496:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108765952 00000100:00100000:2.0:1790391344.961516:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108765952 00000100:00100000:2.0:1790391344.961578:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:2.0:1790391344.961588:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+49:10559:x1877361108765952:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:2.0:1790391344.961822:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+50:10559:x1877361108765952:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 235us (526us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1790391344.961830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:1.0:1790391345.050884:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130800512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391345.050972:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391345.051952:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130800512 00000100:00100000:0.0:1790391345.051963:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130800512 00000100:00100000:0.0:1790391345.052042:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790391345.052053:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130800512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391345.052082:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1790391345.052141:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130800512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391345.052146:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790391345.052225:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1790391345.052231:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1790391345.052257:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130800512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391345.052683:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391345.086609:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391345.086849:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108766208 00000100:00100000:0.0:1790391345.086871:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108766208 00000100:00100000:0.0:1790391345.086945:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 104 00000100:00100000:0.0:1790391345.086957:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+50:10569:x1877361108766208:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:0.0:1790391345.086984:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391345.086988:0:11443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790391345.087058:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449ae21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe04 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391345.087104:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391345.087110:0:11443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391345.087127:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449aea6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe27 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391345.087254:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449aead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391345.087270:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449aead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391345.087281:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449aead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391345.087292:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790391345.087438:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449aea6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe27 expref: 52 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391345.087452:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449aead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe27 expref: 51 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391345.087459:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391345.087462:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391345.087465:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979800, rc 0) 00000100:00100000:0.0:1790391345.087702:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+51:10569:x1877361108766208:12345-192.168.201.8@tcp:101:bash.0 Request processed in 747us (1108us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1790391345.087710:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 104 00000100:00100000:0.0:1790391345.096684:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391345.096778:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108766464 00000100:00100000:1.0:1790391345.096788:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108766464 00000100:00100000:1.0:1790391345.096853:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 105 00000100:00100000:1.0:1790391345.096866:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+51:10569:x1877361108766464:12345-192.168.201.8@tcp:36:bash.0 00010000:00010000:1.0:1790391345.096931:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790391345.096962:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449aead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe27 expref: 51 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391345.096980:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449ae91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe20 expref: 50 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391345.096989:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:1.0:1790391345.096993:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391345.097314:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391345.097325:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391345.097331:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391345.097385:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1790391345.097403:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092782223 reply state 00000000b52f0f4d transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391345.097409:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391345.097661:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:10569:x1877361108766464:12345-192.168.201.8@tcp:36:bash.0 Request processed in 799us (987us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1790391345.097666:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 105 00000020:00080000:1.0:1790391345.097670:0:8292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790391345.106055:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.106305:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108766592 00000100:00100000:2.0:1790391345.106315:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108766592 00000100:00100000:2.0:1790391345.106391:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 106 00000100:00100000:2.0:1790391345.106403:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:10569:x1877361108766592:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391345.106439:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391345.106466:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449aec2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe2e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.106580:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.106596:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.106604:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.106623:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.106634:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107305:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107337:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107343:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107407:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391345.107459:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107468:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107487:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:3.0:1790391345.107490:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391345.107493:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107561:0:3293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107571:0:3293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107646:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.107654:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449aebb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.107698:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.107716:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391345.107753:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790391345.107758:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391345.107777:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.107808:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449aec2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.107822:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.107829:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391345.107831:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391345.107834:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10000, rc 0) 00000100:00100000:2.0:1790391345.109318:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:10569:x1877361108766592:12345-192.168.201.8@tcp:101:bash.0 Request processed in 2907us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391345.109330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 106 00000100:00100000:0.0:1790391345.112988:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.113485:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108766848 00000100:00100000:2.0:1790391345.113495:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108766848 00000100:00100000:2.0:1790391345.113659:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:2.0:1790391345.113670:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:10569:x1877361108766848:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:2.0:1790391345.114260:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+53:10569:x1877361108766848:12345-192.168.201.8@tcp:35:bash.0 Request processed in 590us (1280us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1790391345.114269:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:0.0:1790391345.217126:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.224150:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108766976 00000100:00100000:2.0:1790391345.224168:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108766976 00000100:00100000:2.0:1790391345.224246:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 107 00000100:00100000:2.0:1790391345.224256:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+53:10575:x1877361108766976:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391345.224281:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391345.224303:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449aed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe35 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.224380:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449aed7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.224394:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.224406:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391345.224450:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790391345.224454:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391345.224472:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.224506:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449aed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe35 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.224526:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449aed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe35 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.224536:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391345.228126:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391345.228152:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10200, rc 0) 00000100:00100000:2.0:1790391345.228228:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:10575:x1877361108766976:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 3969us (11109us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391345.228237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 107 00000100:00100000:3.0:1790391345.240767:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.240996:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108767104 00000100:00100000:2.0:1790391345.241006:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108767104 00000100:00100000:2.0:1790391345.241253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00100000:2.0:1790391345.241266:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:10575:x1877361108767104:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391345.241287:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391345.241309:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449aede lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe3c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241517:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241534:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241658:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241675:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241683:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241690:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241773:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241791:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241798:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391345.241832:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790391345.241836:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391345.241976:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241990:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.241999:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242006:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242061:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242069:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391345.242073:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242082:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242095:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:2.0:1790391345.242098:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391345.242112:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242119:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449aee5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242134:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242140:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242146:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242223:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391345.242226:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242232:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242240:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96240bf85e00) 00010000:00010000:2.0:1790391345.242242:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391345.242245:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242251:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449aeec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242286:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449aede lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242311:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.242319:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391345.242321:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391345.242323:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11c00, rc 0) 00000100:00100000:2.0:1790391345.242694:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10575:x1877361108767104:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1430us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391345.242703:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00100000:1.0:1790391345.250109:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391345.250144:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.250268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108767360 00000100:00100000:2.0:1790391345.250277:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108767360 00000100:00100000:2.0:1790391345.250337:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 109 00000100:00100000:2.0:1790391345.250354:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10575:x1877361108767360:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391345.250374:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391345.250395:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449aefa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe43 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.250496:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.250511:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.250518:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.250544:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.250598:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.250611:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 56 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391345.250623:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130800640:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391345.250721:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.250731:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 56 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391345.250740:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130800768:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391345.250762:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391345.252367:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108767488 00000100:00100000:3.0:1790391345.252379:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108767488 00010000:00010000:3.0:1790391345.252418:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 57 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391345.252470:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:3.0:1790391345.252479:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:2365:x1877361108767488:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391345.252492:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391345.252498:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 57 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.252511:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 57 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.252530:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:3.0:1790391345.252535:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.252543:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391345.252558:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391345.252666:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:2365:x1877361108767488:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 187us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391345.252674:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00010000:00010000:2.0:1790391345.258660:0:5836:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.8@tcp) returned -22 from blocking AST (req@00000000ec092c89 x1877361130800640) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 56 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.258688:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449aef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe3c expref: 56 pid: 5837 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391345.258704:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130800640:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391345.258733:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130800768:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391345.258755:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391345.258761:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.258770:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.258780:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391345.259175:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.260120:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108767616 00000100:00100000:2.0:1790391345.260132:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108767616 00010000:00010000:2.0:1790391345.260186:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 56 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391345.260227:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:2.0:1790391345.260237:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:2364:x1877361108767616:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391345.260251:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391345.260258:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 56 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.260270:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 56 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.260292:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449aec9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe2e expref: 56 pid: 5836 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.260321:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391345.260326:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.260334:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.260342:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.260383:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391345.260460:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:2364:x1877361108767616:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 224us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391345.260467:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 53 00010000:00010000:1.0:1790391345.261326:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391345.261338:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391345.261369:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790391345.261558:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449aefa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391345.261587:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391345.261597:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:1.0:1790391345.261600:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391345.261615:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10a00, rc 0) 00000100:00100000:1.0:1790391345.261655:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10575:x1877361108767360:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 11310us (11556us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1790391345.261664:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 109 00000100:00100000:2.0:1790391345.271973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391345.272253:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108767872 00000100:00100000:0.0:1790391345.272265:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108767872 00000100:00100000:0.0:1790391345.272365:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1790391345.272375:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10575:x1877361108767872:12345-192.168.201.8@tcp:103:lfs.0 00010000:00010000:0.0:1790391345.272390:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391345.272491:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449ae60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe19 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391345.272510:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391345.272515:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391345.272657:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:10575:x1877361108767872:12345-192.168.201.8@tcp:103:lfs.0 Request processed in 283us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391345.272666:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:1.0:1790391345.277308:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.277655:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108768000 00000100:00100000:2.0:1790391345.277666:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108768000 00000100:00100000:2.0:1790391345.277758:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 110 00000100:00100000:2.0:1790391345.277768:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:10575:x1877361108768000:12345-192.168.201.8@tcp:58:lfs.0 00010000:00010000:2.0:1790391345.277896:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.277915:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.277927:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391345.278865:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790391345.279380:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:10575:x1877361108768000:12345-192.168.201.8@tcp:58:lfs.0 Request processed in 1608us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391345.279391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 110 00000100:00100000:3.0:1790391345.283740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391345.283801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108768128 00000100:00100000:2.0:1790391345.283811:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108768128 00000100:00100000:2.0:1790391345.283873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 111 00000100:00100000:2.0:1790391345.283883:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:10575:x1877361108768128:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391345.283902:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391345.283923:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe4a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.283984:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.283995:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.284035:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.284049:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.284064:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391345.284068:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391345.284072:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391345.284079:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10000, rc 0) 00000100:00100000:2.0:1790391345.284393:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10575:x1877361108768128:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 510us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391345.284400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 111 00010000:00010000:0.0:1790391345.497263:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391346.138781:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790391346.138790:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790391346.138837:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1790391346.138850:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391346.138990:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130800896:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391346.140307:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391346.145250:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130800896:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790391346.145763:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.157910:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108768256 00000100:00100000:1.0:1790391346.157927:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108768256 00000100:00100000:1.0:1790391346.158034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00100000:1.0:1790391346.158046:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10576:x1877361108768256:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790391346.158080:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790391346.158218:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10576:x1877361108768256:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 174us (12456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.158227:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 112 00000100:00080000:2.0:1790391346.158365:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391346.162604:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.162683:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108768384 00000100:00100000:0.0:1790391346.162692:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108768384 00000100:00100000:0.0:1790391346.162745:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 113 00000100:00100000:0.0:1790391346.162753:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10576:x1877361108768384:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790391346.162821:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162837:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162866:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162915:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162933:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162939:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162963:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162970:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.162976:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391346.163011:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790391346.163045:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391346.163057:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163068:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163074:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163090:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163096:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391346.163108:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163116:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163127:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:0.0:1790391346.163130:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391346.163140:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163147:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163159:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163165:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163171:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163176:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391346.163179:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163192:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163199:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff962430751a00) 00010000:00010000:0.0:1790391346.163202:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391346.163204:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163210:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163223:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163229:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163234:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163239:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391346.163242:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163247:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163253:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391346.163255:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391346.163258:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.163271:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449af2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391346.163332:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10576:x1877361108768384:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 Request processed in 580us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.163339:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 113 00000100:00100000:3.0:1790391346.169965:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.170178:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108768640 00000100:00100000:2.0:1790391346.170188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108768640 00000100:00100000:2.0:1790391346.170248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 114 00000100:00100000:2.0:1790391346.170257:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:10576:x1877361108768640:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391346.170278:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391346.170298:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449af32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe51 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170411:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170425:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170437:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391346.170447:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790391346.170612:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170620:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170627:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170649:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391346.170653:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170665:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170678:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391346.170681:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391346.170685:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170692:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170729:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449af32 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe51 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170740:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:2.0:1790391346.170742:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391346.170746:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449af32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe51 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.170753:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11000, rc 0) 00000100:00100000:2.0:1790391346.170824:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:10576:x1877361108768640:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 568us (869us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1790391346.170831:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 114 00000100:00100000:2.0:1790391346.175359:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.175442:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108768768 00000100:00100000:0.0:1790391346.175452:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108768768 00000100:00100000:0.0:1790391346.175512:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 115 00000100:00100000:0.0:1790391346.175522:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:10576:x1877361108768768:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391346.175933:0:11443:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391346.176058:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:10576:x1877361108768768:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 538us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.176066:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 115 00000100:00100000:3.0:1790391346.179504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.179655:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108769024 00000100:00100000:1.0:1790391346.179666:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108769024 00000100:00100000:1.0:1790391346.179721:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:1.0:1790391346.179729:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:10576:x1877361108769024:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391346.179746:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391346.179749:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790391346.179769:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449aed7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe35 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.179784:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391346.179788:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391346.179798:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449af47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe58 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790391346.180202:0:8292:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1790391346.180347:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449af4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.180357:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449af4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.180365:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449af4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.180400:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449af47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe58 expref: 58 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.180413:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449af4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe58 expref: 57 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.180421:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9624119e7000) 00010000:00010000:1.0:1790391346.180423:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391346.180426:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31e00, rc 0) 00000100:00100000:1.0:1790391346.180474:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:10576:x1877361108769024:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 745us (988us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1790391346.180481:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 116 00000100:00100000:3.0:1790391346.184744:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.184816:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108769280 00000100:00100000:1.0:1790391346.184827:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108769280 00000100:00100000:1.0:1790391346.184930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:1.0:1790391346.184941:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:10576:x1877361108769280:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391346.184999:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391346.185068:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449af4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe58 expref: 57 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185086:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9624119e7000) 00010000:00010000:1.0:1790391346.185096:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391346.185116:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185129:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185140:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185199:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185207:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185214:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185276:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185283:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185291:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185296:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391346.185307:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185316:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185325:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:1.0:1790391346.185329:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391346.185332:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185339:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449af5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185349:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185355:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185361:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185367:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391346.185370:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185376:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185383:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x78a11ab4 (ffff9624119e7d00) 00010000:00010000:1.0:1790391346.185386:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391346.185406:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.185413:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78a11ab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391346.185492:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:10576:x1877361108769280:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 552us (757us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391346.185501:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 117 00000100:00100000:0.0:1790391346.191743:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.191804:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108769408 00000100:00100000:2.0:1790391346.191814:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108769408 00000100:00100000:2.0:1790391346.191871:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:2.0:1790391346.191882:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:10576:x1877361108769408:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391346.191901:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391346.191936:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449af6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe5f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.191972:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.191986:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.191998:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.192135:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449af6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.192154:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.192174:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:2.0:1790391346.192177:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391346.192181:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10600, rc 0) 00000100:00100000:2.0:1790391346.192237:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:10576:x1877361108769408:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 356us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.192244:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 118 00000100:00100000:3.0:1790391346.198759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.198829:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108769664 00000100:00100000:2.0:1790391346.198839:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108769664 00000100:00100000:2.0:1790391346.198899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:2.0:1790391346.198908:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:10576:x1877361108769664:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391346.198985:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.199002:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.199050:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391346.199313:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1790391346.199320:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381533304259ns, next at 382533302899ns, rc = 0 00000004:00010000:2.0:1790391346.199578:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f6ff3d8 reply state 0000000036a9a332 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.199589:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391346.199690:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:10576:x1877361108769664:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 781us (939us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790391346.199698:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 119 00010000:00010000:3.0:1790391346.201615:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.201631:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.201637:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.201644:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391346.201649:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.201657:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.201672:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:3.0:1790391346.201676:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790391346.201681:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.201687:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449af78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391346.202684:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.202733:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108769792 00000100:00100000:1.0:1790391346.202743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108769792 00000100:00100000:1.0:1790391346.202796:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:1.0:1790391346.202806:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:10576:x1877361108769792:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391346.202827:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391346.202843:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe66 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.202898:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.202911:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.202930:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:1.0:1790391346.202933:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391346.202936:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30600, rc 0) 00000100:00100000:1.0:1790391346.202988:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:10576:x1877361108769792:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 183us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.202994:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:2.0:1790391346.204853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.204902:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108769920 00000100:00100000:1.0:1790391346.204908:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108769920 00000100:00080000:2.0:1790391346.204951:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391346.204966:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:1.0:1790391346.204976:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108769920:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790391346.205279:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108769920:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 305us (430us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790391346.205286:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1790391346.207434:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.207517:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108770176 00000100:00100000:1.0:1790391346.207526:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108770176 00000100:00100000:1.0:1790391346.207586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:1.0:1790391346.207595:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:10576:x1877361108770176:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790391346.207883:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:10576:x1877361108770176:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 289us (455us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1790391346.207892:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:3.0:1790391346.213286:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.213405:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108770432 00000100:00100000:1.0:1790391346.213415:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108770432 00000100:00100000:1.0:1790391346.213473:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:1.0:1790391346.213484:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:10576:x1877361108770432:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790391346.213791:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:10576:x1877361108770432:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 309us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.213799:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:2.0:1790391346.215962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.216292:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108770560 00000100:00100000:0.0:1790391346.216303:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108770560 00000100:00100000:0.0:1790391346.216371:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:0.0:1790391346.216381:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:10576:x1877361108770560:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391346.216401:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391346.216422:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe6d expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.216502:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.216540:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.216553:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391346.216591:0:11443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391346.216609:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.216634:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449af86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe6d expref: 62 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.216652:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe6d expref: 61 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.216661:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:0.0:1790391346.216664:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790391346.216668:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978600, rc 0) 00000100:00100000:0.0:1790391346.216729:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:10576:x1877361108770560:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 349us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.216736:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:3.0:1790391346.219685:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.219953:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108770688 00000100:00100000:0.0:1790391346.219964:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108770688 00000100:00100000:0.0:1790391346.220042:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:0.0:1790391346.220053:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108770688:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391346.220070:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391346.220104:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe74 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391346.220130:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab73431, blocks: 0x1 00010000:00010000:0.0:1790391346.220159:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1790391346.220164:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391346.220174:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.220193:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.220206:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979600, rc 0) 00000100:00100000:0.0:1790391346.220266:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108770688:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 215us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.220272:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1790391346.223197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.223296:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108770944 00000100:00100000:1.0:1790391346.223306:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108770944 00000100:00100000:1.0:1790391346.223375:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:1.0:1790391346.223385:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:10576:x1877361108770944:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790391346.223508:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:10576:x1877361108770944:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.223516:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 123 00000100:00100000:2.0:1790391346.227112:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391346.227252:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108771072 00000100:00100000:3.0:1790391346.227262:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108771072 00000100:00100000:3.0:1790391346.227315:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:3.0:1790391346.227324:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:10576:x1877361108771072:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391346.227348:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391346.227366:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe7b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.227396:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.227406:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391346.227410:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391346.227414:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.227444:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.227457:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 9 pid: 6694 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391346.227499:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1877361130801024:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391346.227608:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391346.231205:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.231384:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108771200 00000100:00100000:2.0:1790391346.231393:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108771200 00010000:00010000:2.0:1790391346.231430:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 10 pid: 6694 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.231516:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:2.0:1790391346.231526:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2364:x1877361108771200:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391346.231557:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391346.231583:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 10 pid: 6694 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.231598:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 10 pid: 6694 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.231624:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391346.231628:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391346.231636:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.231647:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.231686:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.231701:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1877361130801152:192.168.201.8@tcp:105: 00000100:00100000:2.0:1790391346.231788:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23d80 going to sleep for 11 seconds 00010000:00010000:1.0:1790391346.232322:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa0037d/0x35e94fc15449af94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe74 expref: 10 pid: 6694 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391346.232339:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1877361130801024:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391346.232363:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.232373:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2e00, rc 0) 00000100:00100000:1.0:1790391346.232405:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:10576:x1877361108771072:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 5082us (5304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.232413:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:2.0:1790391346.235932:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1877361130801152:192.168.201.8@tcp:105: 00010000:00010000:2.0:1790391346.235983:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391346.236498:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108771200:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 4972us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.236510:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:2.0:1790391346.243097:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391346.243320:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108771328 00000100:00100000:3.0:1790391346.243341:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108771328 00002000:00100000:3.0:1790391346.243393:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff962411ad0700 x1877361108771328/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:212/0 lens 504/0 e 0 to 0 dl 1790391357 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790391346.243409:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962411ad0700 with x1877361108771328 ext(0->12) 00002000:00010000:3.0:1790391346.243415:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962411ad0700 00000100:00100000:3.0:1790391346.243452:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:3.0:1790391346.246185:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108771328:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790391346.246685:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2364:x1877361108771328:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 Request processed in 3223us (3600us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790391346.246695:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00002000:00100000:3.0:1790391346.246706:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff962411ad0700 x1877361108771328/t4294967309(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:212/0 lens 504/448 e 0 to 0 dl 1790391357 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790391346.246715:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962411ad0700 with x1877361108771328 ext(0->12) 00002000:00010000:3.0:1790391346.246721:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962411ad0700 00000100:00100000:0.0:1790391346.249861:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.249934:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108771456 00000100:00100000:1.0:1790391346.249943:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108771456 00000100:00100000:1.0:1790391346.249996:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:1.0:1790391346.250006:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:10576:x1877361108771456:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1790391346.299089:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:10576:x1877361108771456:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 Request processed in 49072us (49225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.299103:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 124 00000001:00080000:2.0:1790391346.301116:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000020:00080000:2.0:1790391346.301150:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962411a93b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790391346.301156:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962435cc4d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962411a93300 00000020:00080000:2.0:1790391346.301160:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962435cc4500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96243f68b800 00000001:00080000:2.0:1790391346.301200:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1790391346.301216:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1790391346.301236:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1790391346.301267:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790391346.301277:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9624012ed000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790391346.301280:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96240e877300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9624012ed480 00000020:00080000:2.0:1790391346.301282:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96240e877a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96243f56fc00 00000100:00100000:2.0:1790391346.301460:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130801280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790391346.301517:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790391346.301706:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1790391346.301915:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790391346.302317:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130801408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790391346.302364:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391346.302384:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391346.302390:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96241f2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130801536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790391346.302412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391346.302877:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130801280 00000100:00100000:1.0:1790391346.302886:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130801280 00000100:00100000:1.0:1790391346.302934:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130801408 00000100:00100000:1.0:1790391346.302937:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130801408 00000100:00100000:1.0:1790391346.302965:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130801536 00000100:00100000:1.0:1790391346.302968:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130801536 00000100:00100000:1.0:1790391346.302995:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790391346.303004:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1877361130801280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790391346.303047:0:8917:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1790391346.303073:0:8917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.303095:0:8917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 9 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.303103:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790391346.303108:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391346.303112:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.303154:0:8917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 9 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.303169:0:8917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 9 pid: 8917 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391346.303182:0:8917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96241f2a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8917:1877361130801664:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391346.303283:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391346.303293:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130801408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790391346.303445:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790391346.303448:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790391345 00002000:00010000:3.0:1790391346.303457:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790391346.303460:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790391345 -> 1790391345 00002000:00010000:3.0:1790391346.303462:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790391346.303504:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130801408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (1139us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790391346.303511:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391346.303527:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790391346.303544:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130801536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790391346.303564:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1790391346.303585:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab73430, atime: 0x6ab73430, ctime: 0x6ab73430, blocks: 0x1 00010000:00010000:3.0:1790391346.303592:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.303601:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1790391346.303604:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391346.303610:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.303624:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.303634:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.303641:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.303669:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790391346.304132:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130801536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 588us (1717us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790391346.304139:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1790391346.304159:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391346.304165:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.304174:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391346.304179:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.304189:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.304204:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.304211:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e9521e2/0x35e94fc15449afa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.304230:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391346.304232:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391346.304233:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790391346.304473:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96241f2a8380/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790391346.304482:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96241f2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130801536:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1790391346.304508:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962411ad2300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1790391346.304511:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130801408:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1790391346.304664:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391346.304727:0:8917:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391346.305482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.305639:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108771584 00000100:00100000:2.0:1790391346.305647:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108771584 00000100:00100000:2.0:1790391346.305690:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:2.0:1790391346.305699:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2364:x1877361108771584:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790391346.305827:0:6695:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1790391346.305838:0:6695:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1790391346.309827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.309858:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108771712 00000100:00100000:1.0:1790391346.309881:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108771712 00010000:00010000:1.0:1790391346.309929:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 11 pid: 8917 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391346.309967:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:1.0:1790391346.309978:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:2364:x1877361108771712:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391346.309992:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391346.309998:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 11 pid: 8917 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.310011:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 11 pid: 8917 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.310059:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391346.310064:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391346.310070:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.310078:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.310098:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391346.310214:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:2364:x1877361108771712:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 235us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.310222:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 55 00010000:00010000:3.0:1790391346.311396:0:8917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020c44817/0x35e94fc15449ad64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdda expref: 10 pid: 8917 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391346.311435:0:8917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96241f2a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8917:1877361130801664:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391346.311461:0:8917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.311471:0:8917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.311478:0:8917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.311488:0:8917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.311496:0:8917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.311639:0:8917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391346.312239:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391346.312247:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.312262:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391346.312267:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.312275:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.312294:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.312303:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004decb417/0x35e94fc15449afa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.312323:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391346.312325:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391346.312339:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391346.312992:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130801280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9984us (11470us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790391346.313005:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1790391346.313425:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962411ad0a80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1790391346.313433:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130801280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790391346.361757:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108771584:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 Request processed in 56047us (56267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.361771:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 45 00000001:00080000:0.0:1790391346.362411:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1790391346.362426:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1790391346.362431:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1790391346.365692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.365783:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108771968 00000100:00100000:2.0:1790391346.365794:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108771968 00000100:00100000:2.0:1790391346.365851:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 125 00000100:00100000:2.0:1790391346.365861:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:10576:x1877361108771968:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391346.365915:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391346.366600:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449af8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe6d expref: 15 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.366623:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:2.0:1790391346.366628:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391346.366663:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.366676:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.366701:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391346.367011:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000bbf863 reply state 00000000d038220c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.367524:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391346.367647:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:10576:x1877361108771968:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 1784us (1962us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1790391346.367655:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 125 00010000:00010000:3.0:1790391346.370471:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.370489:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.370517:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.370523:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391346.370539:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.370548:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.370565:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:3.0:1790391346.370568:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391346.370573:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.370580:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449afb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391346.372740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.372823:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108772096 00000100:00100000:2.0:1790391346.372834:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108772096 00000100:00100000:2.0:1790391346.372893:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:2.0:1790391346.372903:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108772096:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790391346.373190:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790391346.373194:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790391345 -> 1790391344 00002000:00010000:2.0:1790391346.373196:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790391344 00002000:00010000:2.0:1790391346.373198:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790391345 -> 1790391344 00002000:00010000:2.0:1790391346.373200:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790391346.373252:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108772096:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 350us (524us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790391346.373261:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:1.0:1790391346.376063:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.376229:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108772352 00000100:00100000:2.0:1790391346.376238:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108772352 00000100:00100000:2.0:1790391346.376301:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 126 00000100:00100000:2.0:1790391346.376311:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:10576:x1877361108772352:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790391346.376405:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.376422:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.376432:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.376465:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.376480:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 15 pid: 5838 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.376494:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130801792:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391346.376585:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391346.379130:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.379321:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108772480 00000100:00100000:0.0:1790391346.379336:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108772480 00010000:00010000:0.0:1790391346.379378:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 16 pid: 5838 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391346.379439:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:0.0:1790391346.379448:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:2364:x1877361108772480:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391346.379463:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391346.379470:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 16 pid: 5838 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.379484:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 16 pid: 5838 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.379506:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:0.0:1790391346.379511:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.379520:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.379536:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.379556:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391346.379608:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:2364:x1877361108772480:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 161us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.379616:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 56 00010000:00010000:2.0:1790391346.380360:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449af71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe5f expref: 15 pid: 5838 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.380377:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130801792:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391346.380396:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380406:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380411:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380448:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380456:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380463:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380468:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391346.380472:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380480:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380493:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:2.0:1790391346.380495:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790391346.380500:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.380506:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449afb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.380608:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10576:x1877361108772352:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 Request processed in 4298us (4554us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790391346.380617:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 126 00000100:00100000:1.0:1790391346.383536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.383628:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108772608 00000100:00100000:0.0:1790391346.383639:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108772608 00000100:00100000:0.0:1790391346.383698:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:0.0:1790391346.383710:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108772608:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790391346.383786:0:12080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.383813:0:12080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.383823:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391346.383828:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391346.383835:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.383878:0:12080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.383895:0:12080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 7 pid: 6697 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391346.383911:0:12080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12080:1877361130801920:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391346.384536:0:12080:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391346.388063:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.388145:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108772736 00000100:00100000:2.0:1790391346.388154:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108772736 00010000:00010000:2.0:1790391346.388201:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 8 pid: 6697 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.388258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:2.0:1790391346.388269:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108772736:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391346.388285:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391346.388307:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 8 pid: 6697 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.388322:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 8 pid: 6697 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.388360:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391346.388365:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391346.388372:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.388382:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.388405:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391346.388511:0:12080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b1c80e4/0x35e94fc15449af9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe7b expref: 8 pid: 6697 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391346.388538:0:12080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12080:1877361130801920:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391346.388559:0:12080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388582:0:12080:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388589:0:12080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388612:0:12080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388620:0:12080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388627:0:12080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388633:0:12080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391346.388638:0:12080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388647:0:12080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388659:0:12080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.388679:0:12080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c022fc9/0x35e94fc15449afbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.389514:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108772736:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 1243us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.389524:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:0.0:1790391346.389593:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108772608:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 Request processed in 5884us (6073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.389601:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:3.0:1790391346.391787:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.391883:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108772992 00000100:00100000:1.0:1790391346.391893:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108772992 00000100:00100000:1.0:1790391346.391975:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 127 00000100:00100000:1.0:1790391346.391984:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10576:x1877361108772992:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790391346.392105:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.392123:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.392237:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.392525:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.392548:0:8292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.392557:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.392593:0:8292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.392607:0:8292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 15 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391346.392621:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96241f2ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130802048:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391346.392729:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391346.396843:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.396934:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108773120 00000100:00100000:0.0:1790391346.396943:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108773120 00010000:00010000:0.0:1790391346.396980:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 16 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391346.397042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:0.0:1790391346.397052:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:2363:x1877361108773120:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391346.397065:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391346.397072:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 16 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.397084:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 16 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.397104:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:0.0:1790391346.397109:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.397119:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.397289:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391346.397309:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391346.397368:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+16:2363:x1877361108773120:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 317us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.397375:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 58 00010000:00010000:2.0:1790391346.397500:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449af7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe66 expref: 15 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.397517:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96241f2ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130802048:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391346.397555:0:8292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.397564:0:8292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.397570:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391346.397751:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1790391346.397893:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1790391346.398216:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1790391346.398297:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130802176:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790391346.399906:0:8292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391346.399983:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391346.400243:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130802176 00000100:00100000:3.0:1790391346.400252:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130802176 00000100:00100000:2.0:1790391346.400388:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391346.400398:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8292:x1877361130802176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790391346.400495:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8292:x1877361130802176:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.400502:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391346.400672:0:8292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1790391346.400678:0:8292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962411ad2300, transno 4294967310 00000100:00100000:3.0:1790391346.400696:0:8292:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff962411ad0a80 x1877361130801280/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790391362 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391346.400709:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130802176:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790391346.401295:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1790391346.401396:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130802304:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790391346.401466:0:8292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.401854:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391346.401972:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130802304 00000100:00100000:1.0:1790391346.401980:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130802304 00000100:00100000:1.0:1790391346.402277:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391346.402293:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8292:x1877361130802304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790391346.402503:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8292:x1877361130802304:12345-0@lo:1000:mdt00_003.0 Request processed in 210us (1035us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790391346.402510:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391346.402591:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130802304:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790391346.402630:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402642:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402649:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402656:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391346.402661:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402669:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402684:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85e00) 00010000:00010000:3.0:1790391346.402687:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391346.402692:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402698:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449afcc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402729:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402736:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402749:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402755:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391346.402758:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402765:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402774:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:3.0:1790391346.402777:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391346.402783:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402794:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402803:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.402829:0:8292:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391346.402840:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130802432:192.168.201.8@tcp:105: 00000100:00100000:3.0:1790391346.402908:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391346.405473:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130802432:192.168.201.8@tcp:105: 00010000:00010000:2.0:1790391346.405504:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405516:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449af0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405560:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405590:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405601:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405612:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405618:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405625:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405630:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391346.405635:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405642:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405652:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391346.405655:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391346.405658:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405664:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449afd3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405673:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405684:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405690:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405694:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391346.405697:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405702:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405709:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391346.405711:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391346.405713:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.405718:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.405934:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:10576:x1877361108772992:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 13950us (14153us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1790391346.405944:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 127 00000020:00080000:2.0:1790391346.405949:0:8292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790391346.408965:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790391346.408977:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790391346.409547:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790391346.409557:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391346.409937:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.410045:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.410073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108773248 00000100:00100000:2.0:1790391346.410081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108773248 00000100:00100000:2.0:1790391346.410116:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108773504 00000100:00100000:2.0:1790391346.410126:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108773504 00000100:00100000:2.0:1790391346.410150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:2.0:1790391346.410160:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10575:x1877361108773248:12345-192.168.201.8@tcp:49:lfs.0 00000100:00100000:2.0:1790391346.410272:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:10575:x1877361108773248:12345-192.168.201.8@tcp:49:lfs.0 Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.410279:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:2.0:1790391346.410293:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:2.0:1790391346.410299:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:10576:x1877361108773504:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790391346.410833:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790391346.410931:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1790391346.410970:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.410987:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.410999:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411007:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411034:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411041:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411059:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790391346.411107:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:10576:x1877361108773504:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 807us (1060us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1790391346.411121:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00000020:00080000:2.0:1790391346.411125:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790391346.411168:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391346.411174:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411181:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391346.411185:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411193:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411204:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96240bf85f00) 00010000:00010000:2.0:1790391346.411207:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790391346.411212:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411218:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449afda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.411232:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391346.411234:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391346.411235:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391346.414783:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391346.414853:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108773760 00000100:00100000:0.0:1790391346.414863:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108773760 00000100:00100000:0.0:1790391346.414958:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 128 00000100:00100000:0.0:1790391346.414969:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:10575:x1877361108773760:12345-192.168.201.8@tcp:58:lfs.0 00000040:00080000:0.0:1790391346.415268:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1790391346.415373:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:10575:x1877361108773760:12345-192.168.201.8@tcp:58:lfs.0 Request processed in 405us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391346.415380:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 128 00000100:00100000:2.0:1790391346.447231:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391346.447334:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108773888 00000100:00100000:1.0:1790391346.447344:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108773888 00000100:00100000:1.0:1790391346.447411:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 129 00000100:00100000:1.0:1790391346.447423:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:10578:x1877361108773888:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391346.447449:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391346.447470:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449afe1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447544:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447559:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447573:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447589:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447598:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447604:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447858:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447868:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447875:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447909:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391346.447921:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 21 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391346.447936:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96241f2aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130802560:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391346.448060:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391346.458620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391346.458837:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108774144 00000100:00100000:3.0:1790391346.458847:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108774144 00000100:00100000:3.0:1790391346.458905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:3.0:1790391346.458915:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:5603:x1877361108774144:12345-192.168.201.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790391346.459360:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:5603:x1877361108774144:12345-192.168.201.8@tcp:35:ldlm_bl.0 Request processed in 445us (749us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1790391346.459368:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391346.460234:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96241f2aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130802560:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391346.460267:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391346.462471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391346.462573:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108774272 00000100:00100000:2.0:1790391346.462583:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108774272 00010000:00010000:2.0:1790391346.462623:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 23 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391346.462716:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:2.0:1790391346.462726:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:2364:x1877361108774272:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391346.462740:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391346.462747:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 23 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.462761:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 23 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.462785:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10a00/0x35e94fc15449af01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe43 expref: 23 pid: 5836 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.462801:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:2.0:1790391346.462806:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.462816:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.462824:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391346.462896:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391346.463254:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:2364:x1877361108774272:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 527us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.463262:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 59 00010000:00010000:3.0:1790391346.463524:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463543:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391346.463586:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790391346.463591:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391346.463614:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463628:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463637:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463643:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463650:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463664:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391346.463669:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463676:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463687:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:3.0:1790391346.463690:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391346.463694:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463700:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449afe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463712:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463718:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463724:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463730:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391346.463732:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463738:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463757:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9624119e7700) 00010000:00010000:3.0:1790391346.463759:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391346.463763:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463768:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449afef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463806:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449afe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe82 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463820:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe82 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391346.463827:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:3.0:1790391346.463829:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391346.463832:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30c00, rc 0) 00000100:00100000:3.0:1790391346.463871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10578:x1877361108773888:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 16451us (16651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391346.463878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 129 00010000:00010000:1.0:1790391346.521301:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391347.361973:0:12119:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391347.361986:0:12119:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391347.362150:0:12119:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790391347.362157:0:12119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790391347.419963:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391347.419987:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391347.420077:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790391347.420083:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391347.420326:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130802688:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790391347.420419:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a15b300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391347.425923:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130802688:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790391347.428405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391347.428994:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108774400 00000100:00100000:3.0:1790391347.429005:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108774400 00000100:00100000:3.0:1790391347.429098:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 130 00000100:00100000:3.0:1790391347.429109:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10590:x1877361108774400:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790391347.429158:0:8292:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790391347.430474:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10590:x1877361108774400:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 1360us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391347.430496:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 130 00000100:00100000:3.0:1790391347.437097:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391347.437233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108774656 00000100:00100000:0.0:1790391347.437243:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108774656 00000100:00100000:0.0:1790391347.437305:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 131 00000100:00100000:0.0:1790391347.437324:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:10590:x1877361108774656:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391347.437345:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391347.437365:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449affd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe89 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391347.437461:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449b004 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391347.437492:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449b004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391347.437505:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449b004 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391347.437528:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790391347.437661:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449affd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe89 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391347.437684:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449b004 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe89 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391347.437692:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391347.437695:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391347.437698:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979400, rc 0) 00000100:00100000:0.0:1790391347.437763:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:10590:x1877361108774656:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 440us (675us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1790391347.437770:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 131 00000100:00100000:0.0:1790391347.440889:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391347.441201:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108774912 00000100:00100000:3.0:1790391347.441211:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108774912 00000100:00100000:3.0:1790391347.441273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 132 00000100:00100000:3.0:1790391347.441284:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:10590:x1877361108774912:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790391347.441374:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441390:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441401:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441622:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441630:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441637:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441642:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391347.441648:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441655:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441683:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:3.0:1790391347.441686:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391347.441692:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391347.441698:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b012 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391347.441870:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:10590:x1877361108774912:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 587us (989us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1790391347.441878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 132 00000040:00080000:0.0:1790391347.442404:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391347.442409:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391347.443046:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790391347.443056:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790391347.445964:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391347.446075:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108775040 00000100:00100000:1.0:1790391347.446086:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108775040 00000100:00100000:1.0:1790391347.446168:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:1.0:1790391347.446180:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:2363:x1877361108775040:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391347.446194:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391347.446217:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449b004 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe89 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391347.446240:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:1.0:1790391347.446246:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391347.446319:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:2363:x1877361108775040:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 128us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391347.446328:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:0.0:1790391347.447831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391347.447911:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108775296 00000100:00100000:3.0:1790391347.448197:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108775296 00000100:00100000:3.0:1790391347.448259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:3.0:1790391347.448268:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:10590:x1877361108775296:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790391347.452200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:10590:x1877361108775296:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 3920us (4364us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1790391347.452213:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 34 00010000:00010000:0.0:1790391347.546879:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391348.121268:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130802944:0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.121422:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130802816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391348.125305:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130803072:0@lo:400:kworker.0 00000100:00100000:3.0:1790391348.125449:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130803200:0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.129824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391348.129913:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130803328:0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.129957:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391348.129979:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391348.129987:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130803456:0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.130008:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391348.130085:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130802816 00000100:00100000:2.0:1790391348.130094:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130802816 00000100:00100000:2.0:1790391348.130150:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790391348.131684:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877361130802816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391348.131812:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391348.132811:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877361130802816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2647us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391348.132823:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790391348.132874:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803328 00000100:00100000:2.0:1790391348.132882:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803328 00000100:00100000:2.0:1790391348.132934:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803456 00000100:00100000:2.0:1790391348.132937:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803456 00000100:00100000:2.0:1790391348.132965:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790391348.132973:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130803328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.133040:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130803328:12345-0@lo:400:kworker.0 Request processed in 67us (3081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391348.133061:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790391348.133075:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790391348.133082:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130803456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.133114:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130803456:12345-0@lo:400:kworker.0 Request processed in 33us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391348.133121:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1790391348.133140:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391348.133145:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391348.133208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130803456:0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.133234:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130803328:0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.133267:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130802816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391348.133691:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391348.136294:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130802944 00000100:00100000:1.0:1790391348.136319:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130802944 00000100:00100000:1.0:1790391348.136480:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790391348.136491:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130802944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391348.136836:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130802944:12345-0@lo:400:kworker.0 Request processed in 346us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391348.136844:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790391348.136901:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130802944:0@lo:400:kworker.0 00000100:00100000:0.0:1790391348.138942:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391348.138997:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130803584:0@lo:400:kworker.0 00000100:00100000:0.0:1790391348.139055:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391348.139881:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803072 00000100:00100000:2.0:1790391348.139891:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803072 00000100:00100000:2.0:1790391348.139948:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790391348.139958:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130803072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.140064:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130803072:12345-0@lo:400:kworker.0 Request processed in 108us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391348.140071:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790391348.140096:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803584 00000100:00100000:2.0:1790391348.140100:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803584 00000100:00100000:2.0:1790391348.140129:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391348.140137:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130803584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391348.140322:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391348.140390:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803200 00000100:00100000:3.0:1790391348.140394:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803200 00000100:00100000:3.0:1790391348.140429:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391348.140436:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1877361130803200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391348.140474:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1877361130803200:12345-0@lo:400:kworker.0 Request processed in 38us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391348.140494:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391348.140554:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130803200:0@lo:400:kworker.0 00000100:00100000:0.0:1790391348.140948:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130803072:0@lo:400:kworker.0 00000100:00100000:2.0:1790391348.141727:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130803584:12345-0@lo:400:kworker.0 Request processed in 1587us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391348.141738:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1790391348.141853:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391348.142305:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130803584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391348.490604:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391348.490715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391348.490768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391348.490798:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391348.490826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391348.490851:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108775936 00000100:00100000:1.0:1790391348.490861:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108775936 00000100:00100000:1.0:1790391348.490925:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108775552 00000100:00100000:1.0:1790391348.490929:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108775552 00000100:00100000:1.0:1790391348.490953:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 142 00000100:00100000:1.0:1790391348.490962:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108775936:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391348.491091:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2363:x1877361108775936:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391348.491099:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 142 00000100:00100000:1.0:1790391348.491115:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 143 00000100:00100000:1.0:1790391348.491121:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:2363:x1877361108775552:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391348.491150:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:2363:x1877361108775552:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391348.491157:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 143 00000100:00080000:1.0:1790391348.491293:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391348.492658:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108775680 00000100:00100000:3.0:1790391348.492668:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108775680 00000100:00100000:3.0:1790391348.492736:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108775808 00000100:00100000:3.0:1790391348.492739:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108775808 00000100:00100000:3.0:1790391348.492766:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:3.0:1790391348.492775:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108775680:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391348.492833:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108775680:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 59us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391348.492840:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:3.0:1790391348.492855:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:3.0:1790391348.492861:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108775808:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391348.492883:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108775808:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 22us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391348.492888:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00080000:1.0:1790391348.495253:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391348.495262:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391348.495343:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108775424 00000100:00100000:2.0:1790391348.495354:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108775424 00000100:00100000:2.0:1790391348.495453:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 289 00000100:00100000:2.0:1790391348.495464:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108775424:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391348.495556:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108775424:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 94us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391348.495565:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 289 00010000:00010000:2.0:1790391348.575059:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391349.316972:0:12170:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391349.316982:0:12170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391349.317057:0:12170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790391349.317064:0:12170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790391349.515624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391349.516235:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108776192 00000100:00100000:3.0:1790391349.516246:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108776192 00000100:00100000:3.0:1790391349.516312:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00100000:3.0:1790391349.516324:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:10611:x1877361108776192:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391349.516343:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391349.516365:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b019 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe90 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.516464:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449b020 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.516498:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449b020 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.516512:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449b020 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391349.516524:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790391349.516652:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b019 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe90 expref: 27 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.516671:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449b020 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe90 expref: 26 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.516680:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:3.0:1790391349.516682:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790391349.516687:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2200, rc 0) 00000100:00100000:3.0:1790391349.516748:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10611:x1877361108776192:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 426us (1133us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1790391349.516756:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 133 00000100:00100000:0.0:1790391349.521941:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391349.522054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108776320 00000100:00100000:3.0:1790391349.522063:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108776320 00000100:00100000:3.0:1790391349.522131:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 134 00000100:00100000:3.0:1790391349.522141:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10611:x1877361108776320:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:3.0:1790391349.522212:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522230:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522258:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522293:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522300:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522307:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522313:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391349.522317:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522325:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522338:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:3.0:1790391349.522340:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391349.522345:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391349.522352:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b02e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391349.522430:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:10611:x1877361108776320:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 289us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391349.522438:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 134 00010000:00010000:0.0:1790391349.597133:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391349.653964:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391349.654225:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108776448 00000100:00100000:2.0:1790391349.654235:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108776448 00000100:00100000:2.0:1790391349.654302:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:2.0:1790391349.654311:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108776448:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:2.0:1790391349.654330:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391349.654351:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c708dc7f/0x35e94fc15449b035 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe97 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391349.654378:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab73430, atime: 0x6ab73430, ctime: 0x6ab73430, blocks: 0xb 00010000:00010000:2.0:1790391349.654398:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1790391349.654402:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391349.654412:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c708dc7f/0x35e94fc15449b035 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe97 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391349.654430:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c708dc7f/0x35e94fc15449b035 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe97 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391349.654444:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10a00, rc 0) 00000100:00100000:2.0:1790391349.654546:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108776448:12345-192.168.201.8@tcp:101:cat.0 Request processed in 236us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391349.654553:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:3.0:1790391349.661817:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391349.662692:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108776576 00000100:00100000:0.0:1790391349.662705:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108776576 00002000:00100000:0.0:1790391349.662757:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff962439c71f80 x1877361108776576/t0(0) o3->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:215/0 lens 488/0 e 0 to 0 dl 1790391360 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391349.662768:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962439c71f80 with x1877361108776576 ext(0->4095) 00002000:00010000:0.0:1790391349.662774:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962439c71f80 00000100:00100000:0.0:1790391349.662816:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:0.0:1790391349.662826:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108776576:12345-192.168.201.8@tcp:3:cat.0 00000100:00100000:0.0:1790391349.663062:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108776576:12345-192.168.201.8@tcp:3:cat.0 Request processed in 236us (1270us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790391349.663071:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00002000:00100000:0.0:1790391349.663078:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff962439c71f80 x1877361108776576/t0(0) o3->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:215/0 lens 488/4536 e 0 to 0 dl 1790391360 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391349.663087:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962439c71f80 with x1877361108776576 ext(0->4095) 00002000:00010000:0.0:1790391349.663091:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962439c71f80 00000001:00080000:0.0:1790391349.698636:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1790391349.698756:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1790391349.698864:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:1.0:1790391350.171367:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391350.171395:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130803712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391350.171477:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391350.171653:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803712 00000100:00100000:2.0:1790391350.171661:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803712 00000100:00100000:2.0:1790391350.171751:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391350.171763:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130803712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391350.171801:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391350.171852:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1877361130803712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391350.171858:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391350.171910:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130803712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391350.172188:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391350.619577:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391351.645185:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790391351.801066:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1790391351.801086:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1790391351.811276:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:2.0:1790391351.811307:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1790391351.811351:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1790391351.811366:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9624012ed240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790391351.811372:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96240efec900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9624012ed480 00000020:00080000:2.0:1790391351.811376:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96240efec300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96243f68b000 00000020:00080000:0.0:1790391351.811593:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790391351.811829:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:0.0:1790391352.608110:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391352.608119:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391352.608193:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790391352.608200:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790391352.672150:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391353.242823:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130803840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391353.242823:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130803968:0@lo:400:kworker.0 00000100:00100000:3.0:1790391353.244312:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391353.244328:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130804096:0@lo:400:kworker.0 00000100:00100000:0.0:1790391353.245488:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391353.245501:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130804224:0@lo:400:kworker.0 00000100:00100000:2.0:1790391353.250917:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391353.253328:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803840 00000100:00100000:2.0:1790391353.253344:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803840 00000100:00100000:2.0:1790391353.253437:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790391353.253450:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130803840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391353.254898:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391353.255053:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130803840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1604us (4143us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391353.255064:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790391353.255915:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790391353.255922:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1790391353.255942:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96241f2a8380, transno 4294967304 00000100:00100000:2.0:1790391353.255971:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130803840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391353.257548:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391353.257599:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391353.257622:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130803968 00000100:00100000:1.0:1790391353.257631:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130803968 00000100:00100000:1.0:1790391353.257686:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1790391353.257697:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130803968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.257771:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130803968:12345-0@lo:400:kworker.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.257799:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1790391353.257868:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130803968:0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.257993:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96241f2a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130804480:0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.258061:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391353.258092:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391353.258099:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96241f2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130804352:0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.258137:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391353.258162:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804480 00000100:00100000:1.0:1790391353.258166:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804480 00000100:00100000:1.0:1790391353.258200:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804352 00000100:00100000:1.0:1790391353.258203:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804352 00000100:00100000:1.0:1790391353.258238:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790391353.258246:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130804480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.258279:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130804480:12345-0@lo:400:kworker.0 Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.258286:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790391353.258310:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790391353.258324:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130804352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.258355:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130804352:12345-0@lo:400:kworker.0 Request processed in 32us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.258361:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1790391353.258377:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391353.258398:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96241f2ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130804352:0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.258409:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96241f2a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130804480:0@lo:400:kworker.0 00000100:00100000:0.0:1790391353.259005:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391353.259335:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804224 00000100:00100000:1.0:1790391353.259342:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804224 00000100:00100000:1.0:1790391353.259396:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790391353.259404:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130804224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.259459:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130804224:12345-0@lo:400:kworker.0 Request processed in 56us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.259466:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1790391353.260039:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391353.260070:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1790391353.260076:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962411ad0a80, transno 4294967311 00000004:00080000:0.0:1790391353.260097:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1790391353.260121:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130804224:0@lo:400:kworker.0 00000100:00100000:3.0:1790391353.260869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391353.261173:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804096 00000100:00100000:0.0:1790391353.261181:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804096 00000100:00100000:0.0:1790391353.261232:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790391353.261249:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130804096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391353.261310:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130804096:12345-0@lo:400:kworker.0 Request processed in 71us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391353.261317:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790391353.261454:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130804096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391353.637585:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391353.637675:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391353.637708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391353.637731:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391353.637766:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391353.637800:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108777216 00000100:00100000:1.0:1790391353.637810:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108777216 00000100:00100000:1.0:1790391353.637866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108776832 00000100:00100000:1.0:1790391353.637870:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108776832 00000100:00100000:1.0:1790391353.637894:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 147 00000100:00100000:1.0:1790391353.637904:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108777216:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391353.637980:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108777216:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.638002:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 147 00000100:00100000:1.0:1790391353.638052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 148 00000100:00100000:1.0:1790391353.638060:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2366:x1877361108776832:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391353.638088:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2366:x1877361108776832:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.638095:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 148 00000100:00100000:1.0:1790391353.638115:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108776960 00000100:00100000:1.0:1790391353.638119:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108776960 00000100:00100000:1.0:1790391353.638145:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108777088 00000100:00100000:0.0:1790391353.638703:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 69 00000100:00100000:0.0:1790391353.638721:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108776960:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391353.638764:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108776960:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 45us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391353.638772:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 69 00000100:00100000:1.0:1790391353.638859:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108777088 00000100:00100000:1.0:1790391353.638901:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 70 00000100:00100000:1.0:1790391353.638908:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108777088:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391353.638935:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108777088:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 28us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.638941:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 70 00000100:00080000:1.0:1790391353.638958:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391353.638962:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391353.638964:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391353.646882:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108776704 00000100:00100000:2.0:1790391353.646904:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108776704 00000100:00100000:2.0:1790391353.646975:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 291 00000100:00100000:2.0:1790391353.646986:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108776704:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391353.648722:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108776704:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 1727us (11140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391353.648745:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 291 00010000:00010000:0.0:1790391353.692316:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391354.701500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391354.701571:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108777344 00000100:00100000:3.0:1790391354.701583:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108777344 00000100:00100000:3.0:1790391354.701654:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 135 00000100:00100000:3.0:1790391354.701665:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:10255:x1877361108777344:12345-192.168.201.8@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790391354.701786:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:10255:x1877361108777344:12345-192.168.201.8@tcp:60:lhsmtool_posix.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391354.701795:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 135 00010000:00010000:0.0:1790391354.713332:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391354.734681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391354.734934:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108777600 00000100:00100000:0.0:1790391354.734946:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108777600 00000100:00100000:0.0:1790391354.735058:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:0.0:1790391354.735070:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:10255:x1877361108777600:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790391354.735746:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:10255:x1877361108777600:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 674us (1073us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1790391354.735756:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:0.0:1790391355.152053:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391355.152488:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108777728 00000100:00100000:1.0:1790391355.152500:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108777728 00000100:00100000:1.0:1790391355.152587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 136 00000100:00100000:1.0:1790391355.152598:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:11064:x1877361108777728:12345-192.168.201.8@tcp:101:lsof.0 00010000:00010000:1.0:1790391355.152618:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391355.152639:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b03c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fe9e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391355.152726:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391355.152740:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391355.152752:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391355.152787:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391355.152791:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391355.152828:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391355.152853:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b03c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391355.152871:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391355.152881:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391355.152883:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391355.152887:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30600, rc 0) 00000100:00100000:1.0:1790391355.152950:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:11064:x1877361108777728:12345-192.168.201.8@tcp:101:lsof.0 Request processed in 353us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391355.152958:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 136 00000100:00080000:3.0:1790391355.153782:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391355.289390:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130804608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391355.289482:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391355.289805:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804608 00000100:00100000:0.0:1790391355.289815:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804608 00000100:00100000:0.0:1790391355.289882:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790391355.289892:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130804608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391355.289928:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391355.289975:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130804608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391355.289993:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1790391355.290111:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391355.290152:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243998b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130804608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391355.743833:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391356.761401:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790391356.898211:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1790391356.898229:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1790391356.898489:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1790391356.898501:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1790391357.785338:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391358.369125:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130804864:0@lo:400:kworker.0 00000100:00100000:1.0:1790391358.369194:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391358.369240:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130805376:0@lo:400:kworker.0 00000100:00100000:1.0:1790391358.369265:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391358.369296:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391358.369302:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130804992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391358.369325:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391358.369393:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804864 00000100:00100000:1.0:1790391358.369400:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804864 00000100:00100000:1.0:1790391358.369446:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790391358.369455:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130804864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391358.369501:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130804864:12345-0@lo:400:kworker.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.369508:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790391358.369529:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130805376 00000100:00100000:1.0:1790391358.369532:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130805376 00000100:00100000:3.0:1790391358.369687:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130804736:0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.369727:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391358.369752:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130805248:0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.369773:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391358.369791:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391358.369796:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130805120:0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.369816:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391358.369839:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130805248 00000100:00100000:3.0:1790391358.369842:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130805248 00000100:00100000:1.0:1790391358.370053:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804992 00000100:00100000:1.0:1790391358.370057:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804992 00000100:00100000:3.0:1790391358.372967:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130805120 00000100:00100000:3.0:1790391358.372980:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130805120 00000100:00100000:3.0:1790391358.373034:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790391358.373043:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130805248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391358.373412:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790391358.373424:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130805376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.373494:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130805248:12345-0@lo:400:kworker.0 Request processed in 452us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.373494:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130805376:12345-0@lo:400:kworker.0 Request processed in 73us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391358.373515:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790391358.373515:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391358.373652:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790391358.373660:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130805120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.373692:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130805120:12345-0@lo:400:kworker.0 Request processed in 34us (3875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391358.373698:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790391358.373719:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130804736 00000100:00100000:3.0:1790391358.373724:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130804736 00000100:00100000:3.0:1790391358.373752:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790391358.373758:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130804736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.373790:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3308:x1877361130804736:12345-0@lo:400:kworker.0 Request processed in 32us (4063us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391358.373796:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1790391358.373858:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130805120:0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.373869:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c86877e-0672-4feb-acd6-39a38006ba27:3308:1877361130804736:0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.373881:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130805248:0@lo:400:kworker.0 00000100:00100000:3.0:1790391358.373994:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130805504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391358.374274:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391358.374316:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130805504 00000100:00100000:3.0:1790391358.374321:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130805504 00000100:00100000:3.0:1790391358.374358:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391358.374365:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130805504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391358.374393:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391358.374428:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130805504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391358.374442:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391358.374474:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130805504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391358.374535:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130804864:0@lo:400:kworker.0 00000100:00100000:0.0:1790391358.374845:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130805376:0@lo:400:kworker.0 00000100:00100000:1.0:1790391358.375162:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391358.375172:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130804992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391358.375229:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130804992:12345-0@lo:400:kworker.0 Request processed in 60us (5902us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.375247:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1790391358.376682:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391358.376700:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391358.376703:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391358.380042:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130804992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391358.736612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391358.736664:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391358.736689:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391358.736709:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391358.736751:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391358.736782:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108777856 00000100:00100000:1.0:1790391358.736792:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108777856 00000100:00100000:1.0:1790391358.736840:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 293 00000100:00100000:1.0:1790391358.736850:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108777856:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391358.736918:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108777856:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.736925:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 293 00000100:00100000:1.0:1790391358.736959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108777984 00000100:00100000:1.0:1790391358.736963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108777984 00000100:00100000:1.0:1790391358.737000:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108778368 00000100:00100000:1.0:1790391358.737003:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108778368 00000100:00100000:1.0:1790391358.737045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 152 00000100:00100000:1.0:1790391358.737051:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2366:x1877361108777984:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391358.737081:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2366:x1877361108777984:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 31us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.737087:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 152 00000100:00100000:1.0:1790391358.737097:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 153 00000100:00100000:1.0:1790391358.737102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2366:x1877361108778368:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391358.737118:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2366:x1877361108778368:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 17us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.737123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 153 00000100:00080000:1.0:1790391358.737141:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391358.739083:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108778240 00000100:00100000:0.0:1790391358.739099:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108778240 00000100:00100000:0.0:1790391358.739166:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108778112 00000100:00100000:0.0:1790391358.739170:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108778112 00000100:00100000:0.0:1790391358.739203:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00100000:0.0:1790391358.739212:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108778240:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391358.739291:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108778240:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 78us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.739299:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00100000:0.0:1790391358.739317:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 74 00000100:00100000:0.0:1790391358.739335:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108778112:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391358.739361:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108778112:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 37us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.739368:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 74 00000100:00080000:1.0:1790391358.744686:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391358.744698:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790391358.810502:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790391359.203889:0:12372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:55:57 (1790391357) 00010000:00010000:0.0:1790391359.836531:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391360.411476:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130805632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391360.411566:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391360.411741:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130805632 00000100:00100000:0.0:1790391360.411749:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130805632 00000100:00080000:1.0:1790391360.411778:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391360.411846:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790391360.411857:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130805632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391360.411907:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391360.411970:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a002850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130805632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391360.411978:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790391360.412278:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130805632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391360.585154:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391360.585306:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108778624 00000100:00100000:3.0:1790391360.585316:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108778624 00000100:00100000:3.0:1790391360.585453:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 137 00000100:00100000:3.0:1790391360.585464:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:11329:x1877361108778624:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391360.585483:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391360.585500:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b04a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fea5 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.585583:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.585606:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.585631:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.585646:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.585653:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.585659:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.587825:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b05f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.587848:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b05f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.587859:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b05f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391360.587876:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790391360.588120:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588128:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588135:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588141:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391360.588146:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588154:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588166:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9624119e7600) 00010000:00010000:3.0:1790391360.588170:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391360.588174:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588192:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b051 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588203:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588207:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588210:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588214:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391360.588215:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588219:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588223:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff962411373b00) 00010000:00010000:3.0:1790391360.588225:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391360.588226:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588229:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b058 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588842:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b04a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fea5 expref: 16 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588871:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b05f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fea5 expref: 15 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391360.588878:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:3.0:1790391360.588881:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391360.588884:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3600, rc 0) 00000100:00100000:3.0:1790391360.588974:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:11329:x1877361108778624:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 3511us (3831us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790391360.588983:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 137 00000100:00080000:1.0:1790391360.590410:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391360.593373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391360.593881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391360.594948:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108778880 00000100:00100000:0.0:1790391360.594960:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108778880 00000100:00100000:0.0:1790391360.595062:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:0.0:1790391360.595073:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411b0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:2365:x1877361108778880:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391360.595087:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391360.595111:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b05f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fea5 expref: 15 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391360.595144:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:0.0:1790391360.595149:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391360.595258:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411b0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:2365:x1877361108778880:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 188us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391360.595266:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:1.0:1790391360.595993:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108778752 00000100:00100000:1.0:1790391360.596000:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108778752 00000100:00100000:1.0:1790391360.596069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 138 00000100:00100000:1.0:1790391360.596078:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:11329:x1877361108778752:12345-192.168.201.8@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790391360.597793:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:11329:x1877361108778752:12345-192.168.201.8@tcp:59:lhsmtool_posix.0 Request processed in 1705us (4416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391360.597806:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 138 00000040:00080000:0.0:1790391360.798437:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391360.798445:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391360.799080:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790391360.799090:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790391360.860308:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391361.881190:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790391362.037690:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1790391362.527972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391362.528067:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108779008 00000100:00100000:2.0:1790391362.528078:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108779008 00000100:00100000:2.0:1790391362.528143:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 139 00000100:00100000:2.0:1790391362.528165:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:11371:x1877361108779008:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391362.528183:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391362.528203:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b06d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1feac expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528277:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528294:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528306:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528321:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528328:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528334:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528705:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528714:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528721:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528728:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391362.528732:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528740:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528752:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391362.528755:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391362.528759:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528766:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528777:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528783:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528789:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528799:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391362.528802:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528808:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528815:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96240bf85800) 00010000:00010000:2.0:1790391362.528818:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391362.528821:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528827:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b07b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528861:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b06d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feac expref: 14 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528870:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391362.528873:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391362.528876:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b06d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feac expref: 14 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.528885:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11a00, rc 0) 00000100:00100000:2.0:1790391362.528942:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:11371:x1877361108779008:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 791us (977us total) trans 0 rc 301/301 00000100:00100000:2.0:1790391362.528950:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 139 00000100:00080000:0.0:1790391362.529048:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391362.543010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391362.543133:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108779264 00000100:00100000:3.0:1790391362.543144:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108779264 00000100:00100000:3.0:1790391362.543204:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 140 00000100:00100000:3.0:1790391362.543215:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:11371:x1877361108779264:12345-192.168.201.8@tcp:36:lfs.0 00010000:00010000:3.0:1790391362.543284:0:11443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391362.543313:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449a9eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fce5 expref: 13 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.543333:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391362.543339:0:11443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391362.543578:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.543595:0:11443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.543614:0:11443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.543646:0:11443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.543661:0:11443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 5 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391362.543677:0:11443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130805760:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391362.543771:0:11443:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241f1e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391362.548901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391362.548970:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108779392 00000100:00100000:1.0:1790391362.548980:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108779392 00010000:00010000:1.0:1790391362.549060:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 6 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391362.549096:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:1.0:1790391362.549106:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2363:x1877361108779392:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391362.549119:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391362.549126:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 6 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.549140:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 6 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.549162:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391362.549167:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.549177:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.549194:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.549215:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391362.549273:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2363:x1877361108779392:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 158us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391362.549281:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 60 00010000:00010000:3.0:1790391362.549498:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b043 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe9e expref: 5 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391362.549514:0:11443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130805760:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391362.549538:0:11443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.549547:0:11443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.549553:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.549638:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.549648:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.549664:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790391362.550687:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1790391362.551354:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790391362.551375:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.551385:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.551392:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.551398:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391362.551403:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.551411:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.551427:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391362.551429:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391362.551435:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.551442:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b082 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391362.551462:0:11443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3c9caf2 reply state 0000000050c01fc0 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391362.551484:0:11443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391362.551716:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:11371:x1877361108779264:12345-192.168.201.8@tcp:36:lfs.0 Request processed in 8500us (8711us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1790391362.551725:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 140 00010000:00010000:3.0:1790391362.558850:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.558873:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.558881:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.558887:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391362.558893:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.558901:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.558919:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff962411373300) 00010000:00010000:3.0:1790391362.558923:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391362.558928:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.558934:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b089 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391362.634103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391362.634227:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108779520 00000100:00100000:3.0:1790391362.634239:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108779520 00000100:00100000:3.0:1790391362.634337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 141 00000100:00100000:3.0:1790391362.634351:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:11379:x1877361108779520:12345-192.168.201.8@tcp:101:lctl.0 00010000:00010000:3.0:1790391362.634378:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391362.634409:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1feb3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.634483:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b097 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.634498:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.634511:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391362.634553:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790391362.634556:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391362.634586:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.634608:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feb3 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.634626:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feb3 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.634636:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:3.0:1790391362.634639:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391362.634642:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2000, rc 0) 00000100:00100000:3.0:1790391362.634705:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:11379:x1877361108779520:12345-192.168.201.8@tcp:101:lctl.0 Request processed in 358us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391362.634718:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 141 00000100:00100000:2.0:1790391362.687949:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391362.688142:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108779648 00000100:00100000:0.0:1790391362.688154:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108779648 00000100:00100000:0.0:1790391362.688227:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 142 00000100:00100000:0.0:1790391362.688239:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:11385:x1877361108779648:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:0.0:1790391362.688271:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391362.688293:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b09e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1feba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688421:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688436:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688451:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688710:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688718:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688726:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688854:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449b0b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688862:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449b0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688869:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449b0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391362.688909:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790391362.688914:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391362.688932:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449b0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688944:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688951:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688958:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688964:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391362.688969:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688977:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.688988:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:0.0:1790391362.688991:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391362.688996:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.689003:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b0a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690537:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690671:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690679:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690684:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391362.690688:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690696:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690708:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff962430751c00) 00010000:00010000:0.0:1790391362.690712:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391362.690716:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690723:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b0ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690768:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b09e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feba expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690782:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449b0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feba expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.690789:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391362.690792:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790391362.690800:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978a00, rc 0) 00000100:00100000:0.0:1790391362.690908:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:11385:x1877361108779648:12345-192.168.201.8@tcp:101:bash.0 Request processed in 2670us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391362.690917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 142 00000100:00100000:3.0:1790391362.699846:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391362.700218:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108779904 00000100:00100000:1.0:1790391362.700229:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108779904 00000100:00100000:1.0:1790391362.700300:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 143 00000100:00100000:1.0:1790391362.700311:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+15:11385:x1877361108779904:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391362.700333:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391362.700368:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b0ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fec1 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.700499:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.700513:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.700525:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.700539:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.700546:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.700580:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391362.701344:0:11443:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1790391362.701506:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701518:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701527:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701556:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701564:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701571:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701576:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391362.701581:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701588:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701599:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391362.701602:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391362.701606:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701619:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b0c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391362.701632:0:11443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ccb3cf9 reply state 00000000e98ca93e transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391362.701641:0:11443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790391362.701669:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b0ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 18 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701683:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 17 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.701691:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:2.0:1790391362.701693:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391362.701696:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10800, rc 0) 00000100:00100000:2.0:1790391362.701767:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11385:x1877361108779904:12345-192.168.201.8@tcp:101:bash.0 Request processed in 1459us (1930us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1790391362.701775:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 143 00010000:00010000:3.0:1790391362.703289:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.703307:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.703315:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.703321:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391362.703325:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.703332:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.703350:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9624119e7400) 00010000:00010000:3.0:1790391362.703353:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391362.703358:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.703364:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b0c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391362.705136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391362.705372:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108780032 00000100:00100000:1.0:1790391362.705383:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108780032 00000100:00100000:1.0:1790391362.705450:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:1.0:1790391362.705462:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2364:x1877361108780032:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391362.705480:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391362.705499:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fec8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391362.705526:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391362.705545:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1790391362.705550:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391362.705559:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.705578:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.705591:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30e00, rc 0) 00000100:00100000:1.0:1790391362.705653:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108780032:12345-192.168.201.8@tcp:101:bash.0 Request processed in 194us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391362.705660:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00080000:2.0:1790391362.706297:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391362.709101:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391362.709336:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108780160 00000100:00100000:2.0:1790391362.709346:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108780160 00000100:00100000:2.0:1790391362.709400:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:2.0:1790391362.709410:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:11385:x1877361108780160:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391362.709427:0:12080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391362.709446:0:12080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fecf expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.709493:0:12080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.709502:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391362.709507:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391362.709512:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 7 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.709545:0:12080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.709559:0:12080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 7 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391362.709573:0:12080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12080:1877361130805888:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391362.709656:0:12080:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391362.712978:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391362.713062:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108780288 00000100:00100000:1.0:1790391362.713070:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108780288 00010000:00010000:1.0:1790391362.713113:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 8 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391362.713147:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:1.0:1790391362.713153:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108780288:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391362.713170:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391362.713187:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 8 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.713197:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 8 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.713217:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391362.713220:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391362.713227:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 8 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.713233:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 8 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.713271:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 8 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391362.713285:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1877361130806016:192.168.201.8@tcp:105: 00000100:00100000:1.0:1790391362.713348:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e2d80 going to sleep for 11 seconds 00010000:00010000:2.0:1790391362.714567:0:12080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f6cf89a/0x35e94fc15449b0dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec8 expref: 8 pid: 6695 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391362.714586:0:12080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12080:1877361130805888:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391362.714615:0:12080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 7 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.714627:0:12080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11800, rc 0) 00000100:00100000:2.0:1790391362.714693:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:11385:x1877361108780160:12345-192.168.201.8@tcp:101:bash.0 Request processed in 5284us (5601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.714701:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:1.0:1790391362.715941:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1877361130806016:192.168.201.8@tcp:105: 00010000:00010000:1.0:1790391362.715967:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391362.716390:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108780288:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 3234us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391362.716401:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:0.0:1790391362.717093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391362.717254:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108780544 00000100:00100000:3.0:1790391362.717273:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108780544 00000100:00100000:3.0:1790391362.717330:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:3.0:1790391362.717339:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:11385:x1877361108780544:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:3.0:1790391362.717686:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11385:x1877361108780544:12345-192.168.201.8@tcp:35:bash.0 Request processed in 346us (594us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1790391362.717693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:0.0:1790391362.782420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391362.782530:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108780800 00000100:00100000:1.0:1790391362.782540:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108780800 00000100:00100000:1.0:1790391362.782636:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 144 00000100:00100000:1.0:1790391362.782647:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11395:x1877361108780800:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391362.782671:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391362.782692:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b0eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fed6 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391362.782785:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790391362.782909:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b0eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fed6 expref: 20 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.782978:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:1.0:1790391362.782982:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391362.782988:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b0eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fed6 expref: 20 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.783004:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30000, rc 0) 00000100:00100000:1.0:1790391362.783302:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:11395:x1877361108780800:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 656us (892us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1790391362.783310:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 144 00000100:00100000:0.0:1790391362.785384:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391362.785446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108781056 00000100:00100000:3.0:1790391362.785456:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108781056 00000100:00100000:3.0:1790391362.785508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:3.0:1790391362.785518:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:11395:x1877361108781056:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391362.785726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:11395:x1877361108781056:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 209us (349us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1790391362.785734:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 37 00000040:00080000:0.0:1790391362.843408:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391362.843419:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391362.843657:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1790391362.843664:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391362.866347:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391362.866444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108781184 00000100:00100000:0.0:1790391362.866454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108781184 00000100:00100000:0.0:1790391362.866515:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 145 00000100:00100000:0.0:1790391362.866525:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:11401:x1877361108781184:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391362.866548:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391362.866568:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b0f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fedd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.866636:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b100 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.866650:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.866661:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391362.866713:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790391362.866717:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391362.866736:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.866763:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b0f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fedd expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.866780:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b100 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fedd expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.866790:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391362.866793:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391362.866797:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979000, rc 0) 00000100:00100000:0.0:1790391362.866975:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:11401:x1877361108781184:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 338us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391362.866984:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 145 00000100:00100000:0.0:1790391362.875365:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391362.875473:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108781440 00000100:00100000:2.0:1790391362.875483:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108781440 00000100:00100000:2.0:1790391362.875538:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 146 00000100:00100000:2.0:1790391362.875549:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:11401:x1877361108781440:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391362.875569:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391362.875590:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b107 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fee4 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.875690:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b10e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.875704:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.875717:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391362.875729:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790391362.875875:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b107 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fee4 expref: 24 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.875896:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b10e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fee4 expref: 23 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.875906:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:2.0:1790391362.875922:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391362.875927:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10600, rc 0) 00000100:00100000:2.0:1790391362.875986:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:11401:x1877361108781440:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 439us (632us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1790391362.875994:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 146 00000100:00100000:1.0:1790391362.879924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391362.880094:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108781696 00000100:00100000:2.0:1790391362.880103:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108781696 00000100:00100000:2.0:1790391362.880152:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 147 00000100:00100000:2.0:1790391362.880315:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:11401:x1877361108781696:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391362.880344:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391362.880367:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b11c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1feeb expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.880458:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b123 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.880473:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.880484:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391362.880496:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790391362.880613:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b11c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feeb expref: 26 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.880631:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b123 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feeb expref: 25 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.880658:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:2.0:1790391362.880661:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790391362.880664:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10e00, rc 0) 00000100:00100000:2.0:1790391362.880747:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:11401:x1877361108781696:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 586us (839us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1790391362.880754:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 147 00000100:00100000:0.0:1790391362.882805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391362.883032:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108781824 00000100:00100000:1.0:1790391362.883062:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108781824 00000100:00100000:1.0:1790391362.883281:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391362.883292:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:2365:x1877361108781824:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391362.883308:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391362.883333:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b10e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fee4 expref: 25 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.883351:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:1.0:1790391362.883356:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391362.883403:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:2365:x1877361108781824:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 113us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391362.883409:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391362.891003:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391362.891119:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108781952 00000100:00100000:2.0:1790391362.891130:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108781952 00000100:00100000:2.0:1790391362.891193:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:2.0:1790391362.891205:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108781952:12345-192.168.201.8@tcp:1:lfs.0 00010000:00010000:2.0:1790391362.891249:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.891279:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 6 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.891288:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391362.891292:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391362.891298:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.891332:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 6 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.891346:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 6 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391362.891373:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1877361130806144:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391362.891469:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391362.894838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391362.894985:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1877361130806144:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391362.895071:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391362.895213:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108782080 00000100:00100000:1.0:1790391362.895220:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108782080 00002000:00100000:1.0:1790391362.895278:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff962427f38e00 x1877361108782080/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:228/0 lens 504/0 e 0 to 0 dl 1790391373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391362.895288:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962427f38e00 with x1877361108782080 ext(0->12) 00010000:00010000:1.0:1790391362.895296:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 7 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.895311:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 7 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391362.895318:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff962427f38e00 00000100:00100000:1.0:1790391362.895354:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:1.0:1790391362.895363:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108782080:12345-192.168.201.8@tcp:4:lfs.0 00000100:00100000:1.0:1790391362.895883:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108782080:12345-192.168.201.8@tcp:4:lfs.0 Request processed in 519us (1056us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790391362.895892:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00002000:00100000:1.0:1790391362.895900:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff962427f38e00 x1877361108782080/t4294967305(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:228/0 lens 504/448 e 0 to 0 dl 1790391373 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391362.895908:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962427f38e00 with x1877361108782080 ext(0->12) 00010000:00010000:1.0:1790391362.895914:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 9 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.895926:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 9 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391362.895934:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff962427f38e00 00000100:00100000:1.0:1790391362.899330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391362.899483:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108782208 00000100:00100000:2.0:1790391362.899492:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108782208 00010000:00010000:2.0:1790391362.899530:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 9 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391362.899573:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:2.0:1790391362.899583:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2363:x1877361108782208:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391362.899599:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790391362.899619:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790391362.899622:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790391362 00002000:00010000:2.0:1790391362.899625:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790391362 00002000:00010000:2.0:1790391362.899627:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790391362 00010000:00010000:2.0:1790391362.899633:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 9 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.899647:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 9 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.899689:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b0e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fecf expref: 9 pid: 12080 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.899707:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391362.899712:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391362.899718:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.899729:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.899764:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391362.899818:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108782208:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 236us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.899825:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 62 00010000:00010000:0.0:1790391362.900487:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900499:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900525:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900542:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900551:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900558:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391362.900563:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900572:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900584:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.900592:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449b131 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391362.900656:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108781952:12345-192.168.201.8@tcp:1:lfs.0 Request processed in 9451us (9662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391362.900664:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:1.0:1790391362.904528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391362.904602:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108782464 00000100:00100000:0.0:1790391362.904613:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108782464 00000100:00100000:0.0:1790391362.904669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:0.0:1790391362.904696:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:11401:x1877361108782464:12345-192.168.201.8@tcp:35:lfs.0 00000004:00010000:0.0:1790391362.904765:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b123 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feeb expref: 24 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391362.905491:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1790391362.905546:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00010000:00010000:2.0:1790391362.906379:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790391362.906634:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1790391362.906706:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.906725:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 28 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.906735:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.906774:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 28 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.906789:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 28 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391362.906805:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1877361130806272:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391362.907122:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391362.910187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391362.910352:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1877361130806272:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391362.910380:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391362.910473:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108782592 00000100:00100000:2.0:1790391362.910481:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108782592 00010000:00010000:2.0:1790391362.910521:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 29 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391362.910560:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:2.0:1790391362.910570:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:2363:x1877361108782592:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391362.910584:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391362.910590:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 29 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.910609:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 29 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.910632:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b0cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fec1 expref: 29 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.910648:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:2.0:1790391362.910653:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.910662:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.910669:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391362.910697:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391362.910751:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:2363:x1877361108782592:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 181us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.910759:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 63 00010000:00010000:0.0:1790391362.910813:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391362.910820:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391362.910956:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1790391362.911335:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1790391362.911444:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130806400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790391362.911496:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391362.911521:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391362.911609:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130806400 00000100:00100000:2.0:1790391362.911615:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130806400 00000100:00100000:2.0:1790391362.911658:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391362.911667:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877361130806400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790391362.911731:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877361130806400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.911738:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1790391362.911768:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391362.912465:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130806400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790391362.912909:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1790391362.913323:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130806528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790391362.913368:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391362.913401:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391362.913588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130806528 00000100:00100000:2.0:1790391362.913595:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130806528 00000100:00100000:2.0:1790391362.913637:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391362.913646:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1877361130806528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790391362.913799:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1877361130806528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 153us (429us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790391362.913807:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391362.913966:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1877361130806528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790391362.914043:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1790391362.914092:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.914103:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.914111:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.914130:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391362.914135:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.914143:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.914157:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:1.0:1790391362.914281:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790391362.914288:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391362.914295:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b138 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790391362.914450:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790391362.914539:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1790391362.914550:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398248534025ns, next at 399248531798ns, rc = 0 00000001:00080000:1.0:1790391362.914556:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1790391362.914586:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:1.0:1790391362.914589:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790391362.914595:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b123 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feeb expref: 32 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391362.914685:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:11401:x1877361108782464:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 9993us (10170us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1790391362.914692:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 38 00000020:00080000:1.0:1790391362.914696:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790391362.918414:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391362.918535:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108782720 00000100:00100000:3.0:1790391362.918547:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108782720 00000100:00100000:3.0:1790391362.918608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 148 00000100:00100000:3.0:1790391362.918618:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:11401:x1877361108782720:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391362.918639:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391362.918663:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b13f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fef2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.918726:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b13f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fef2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.918742:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b13f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fef2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391362.918761:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391362.918764:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391362.918780:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3e00, rc 0) 00000100:00100000:3.0:1790391362.918836:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:11401:x1877361108782720:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 221us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391362.918843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 148 00000100:00100000:0.0:1790391362.921752:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391362.922002:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108782976 00000100:00100000:3.0:1790391362.922043:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108782976 00000100:00100000:3.0:1790391362.922090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1790391362.922099:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:11401:x1877361108782976:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391362.922496:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:11401:x1877361108782976:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 397us (753us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1790391362.922504:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:1.0:1790391363.010396:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.010528:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108783232 00000100:00100000:3.0:1790391363.010537:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108783232 00000100:00100000:3.0:1790391363.010597:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 149 00000100:00100000:3.0:1790391363.010609:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+33:11411:x1877361108783232:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391363.010633:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391363.010654:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fef9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391363.010742:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790391363.010866:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b146 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fef9 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.010880:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:3.0:1790391363.010884:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391363.010889:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fef9 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.011144:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3800, rc 0) 00000100:00100000:0.0:1790391363.011471:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11411:x1877361108783232:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 861us (1082us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1790391363.011480:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 149 00000100:00100000:1.0:1790391363.015281:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391363.015418:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108783360 00000100:00100000:2.0:1790391363.015555:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108783360 00000100:00100000:2.0:1790391363.015656:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 150 00000100:00100000:2.0:1790391363.015668:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11411:x1877361108783360:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:2.0:1790391363.015764:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.015782:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.015795:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.015811:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.015819:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.015826:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016084:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016105:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016112:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391363.016161:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016175:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016181:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016187:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016193:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391363.016197:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016206:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016218:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391363.016221:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391363.016226:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016233:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b154 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016262:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016270:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016276:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016281:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391363.016284:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016290:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016298:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96240bf85700) 00010000:00010000:2.0:1790391363.016301:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391363.016304:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016309:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b15b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016324:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016331:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016337:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016349:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391363.016352:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016358:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016366:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391363.016368:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391363.016371:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.016377:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391363.016509:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11411:x1877361108783360:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 842us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391363.016518:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 150 00000100:00100000:1.0:1790391363.019222:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391363.019434:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108783616 00000100:00100000:0.0:1790391363.019444:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108783616 00000100:00100000:0.0:1790391363.019528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:0.0:1790391363.019538:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11411:x1877361108783616:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391363.019784:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:11411:x1877361108783616:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 247us (569us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1790391363.019807:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:1.0:1790391363.058836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391363.059077:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108783872 00000100:00100000:2.0:1790391363.059087:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108783872 00000100:00100000:2.0:1790391363.059144:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 151 00000100:00100000:2.0:1790391363.059155:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:11414:x1877361108783872:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391363.059185:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391363.059208:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff00 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059292:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059330:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059344:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059360:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059368:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059374:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059488:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059497:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059505:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391363.059515:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790391363.059609:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059618:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059624:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059635:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391363.059640:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059647:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059659:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391363.059662:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391363.059667:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059674:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b170 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059686:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059693:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059699:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059704:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391363.059707:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059713:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059731:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96240bf85700) 00010000:00010000:2.0:1790391363.059733:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391363.059736:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059743:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b177 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059785:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 38 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059800:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 37 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.059807:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391363.059810:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391363.059813:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10200, rc 0) 00000100:00100000:2.0:1790391363.059885:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:11414:x1877361108783872:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 731us (1058us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1790391363.059892:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 151 00000100:00100000:3.0:1790391363.062908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391363.063157:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108784000 00000100:00100000:0.0:1790391363.063171:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108784000 00000100:00100000:0.0:1790391363.063245:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 152 00000100:00100000:0.0:1790391363.063267:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:11414:x1877361108784000:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:0.0:1790391363.063360:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063380:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063393:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063425:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063433:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063441:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063447:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391363.063452:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063459:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063472:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391363.063489:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391363.063494:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.063501:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b18c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391363.063578:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:11414:x1877361108784000:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 313us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.063586:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 152 00000100:00100000:1.0:1790391363.066242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.066400:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108784256 00000100:00100000:3.0:1790391363.066410:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108784256 00000100:00100000:3.0:1790391363.066471:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:3.0:1790391363.066480:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:11414:x1877361108784256:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:3.0:1790391363.066773:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+38:11414:x1877361108784256:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 294us (538us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1790391363.066782:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:2.0:1790391363.289868:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391363.290172:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108784512 00000100:00100000:1.0:1790391363.290182:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108784512 00000100:00100000:1.0:1790391363.290241:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 153 00000100:00100000:1.0:1790391363.290278:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+38:11445:x1877361108784512:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:1.0:1790391363.290301:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391363.290325:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b193 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff07 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.290424:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b19a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.290440:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b19a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.290452:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b19a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391363.290465:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790391363.290597:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b193 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff07 expref: 41 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.290618:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b19a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff07 expref: 40 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.290646:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391363.290649:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391363.290653:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30e00, rc 0) 00000100:00100000:1.0:1790391363.290710:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:11445:x1877361108784512:12345-192.168.201.8@tcp:101:cat.0 Request processed in 460us (868us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1790391363.290718:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 153 00000100:00100000:1.0:1790391363.296190:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391363.296238:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.296324:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108784768 00000100:00100000:3.0:1790391363.296335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108784768 00000100:00100000:3.0:1790391363.296394:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:3.0:1790391363.296407:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:11445:x1877361108784768:12345-192.168.201.8@tcp:35:cat.0 00000100:00100000:3.0:1790391363.296683:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+41:11445:x1877361108784768:12345-192.168.201.8@tcp:35:cat.0 Request processed in 278us (504us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790391363.296690:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:0.0:1790391363.297199:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108784896 00000100:00100000:0.0:1790391363.297205:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108784896 00000100:00100000:0.0:1790391363.297262:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1790391363.297271:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+41:2366:x1877361108784896:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391363.297285:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391363.297315:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b19a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff07 expref: 41 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.297333:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391363.297338:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391363.297376:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:2366:x1877361108784896:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 106us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.297382:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:1.0:1790391363.350402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391363.350500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108785152 00000100:00100000:0.0:1790391363.350511:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108785152 00000100:00100000:0.0:1790391363.350574:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 154 00000100:00100000:0.0:1790391363.350584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:11451:x1877361108785152:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:0.0:1790391363.350607:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391363.350624:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790391363.350648:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b100 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fedd expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.350668:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391363.350673:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391363.350687:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b1a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff0e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.350788:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.350801:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 40 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.350808:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.350840:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 40 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.350864:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 40 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391363.350877:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130806656:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391363.350982:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49e480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391363.353911:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130806656:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391363.353958:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391363.355653:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.355939:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108785280 00000100:00100000:3.0:1790391363.355949:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108785280 00010000:00010000:3.0:1790391363.355991:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 41 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391363.356063:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:3.0:1790391363.356073:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411b0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+41:2364:x1877361108785280:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391363.356088:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391363.356104:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 41 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.356117:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 41 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.356139:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10200/0x35e94fc15449b17e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff00 expref: 41 pid: 11443 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.356156:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391363.356162:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.356171:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.356178:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.356218:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391363.356290:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411b0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:2364:x1877361108785280:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 218us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391363.356298:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 64 00010000:00010000:2.0:1790391363.357066:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.357077:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391363.357098:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790391363.357271:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b1a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.357290:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391363.357298:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391363.357301:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391363.357304:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979c00, rc 0) 00000100:00100000:2.0:1790391363.357349:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:11451:x1877361108785152:12345-192.168.201.8@tcp:101:dd.0 Request processed in 6766us (6956us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790391363.357357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 154 00000100:00100000:1.0:1790391363.365153:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.365372:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108785536 00000100:00100000:3.0:1790391363.365382:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108785536 00000100:00100000:3.0:1790391363.365457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 155 00000100:00100000:3.0:1790391363.365468:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:11451:x1877361108785536:12345-192.168.201.8@tcp:36:dd.0 00010000:00010000:3.0:1790391363.365760:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.365801:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.365815:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391363.365897:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1790391363.365938:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d75c4ee9 reply state 000000007da2dddb transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391363.365948:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391363.366417:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+43:11451:x1877361108785536:12345-192.168.201.8@tcp:36:dd.0 Request processed in 948us (1273us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1790391363.366426:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 155 00000020:00080000:3.0:1790391363.366432:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790391363.374175:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.374195:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.374204:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.374210:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391363.374214:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.374222:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.374239:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391363.374267:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391363.374273:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.374280:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391363.481541:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391363.481830:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130806912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.481895:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391363.481952:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391363.481958:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130807040:0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.481982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391363.482011:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130806912 00000100:00100000:3.0:1790391363.482045:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130806912 00000100:00100000:3.0:1790391363.482095:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391363.482104:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130806912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.482160:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130806912:12345-0@lo:400:kworker.0 Request processed in 57us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391363.482167:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391363.482206:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130806912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.482763:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96241f2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130807296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391363.482794:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391363.482822:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391363.482827:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130807168:0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.482845:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391363.482867:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130807296 00000100:00100000:3.0:1790391363.482871:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130807296 00000100:00100000:3.0:1790391363.482901:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391363.482908:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130807296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391363.482924:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391363.482959:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130807296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391363.482966:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391363.482998:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96241f2a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130807296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391363.483064:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130807168 00000100:00100000:3.0:1790391363.483068:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130807168 00000100:00100000:3.0:1790391363.483101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790391363.483220:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130807168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.483266:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130807168:12345-0@lo:400:kworker.0 Request processed in 159us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391363.483272:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1790391363.483289:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391363.483306:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130807168:0@lo:400:kworker.0 00000100:00100000:2.0:1790391363.485279:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130807040 00000100:00100000:2.0:1790391363.485294:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130807040 00000100:00100000:2.0:1790391363.485364:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391363.485373:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130807040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391363.485453:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130807040:12345-0@lo:400:kworker.0 Request processed in 82us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391363.485461:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1790391363.485479:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391363.485512:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130807040:0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.485668:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130806784:0@lo:400:kworker.0 00000100:00100000:3.0:1790391363.485708:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391363.485806:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130806784 00000100:00100000:2.0:1790391363.485810:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130806784 00000100:00100000:2.0:1790391363.485843:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790391363.485849:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130806784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391363.485880:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130806784:12345-0@lo:400:kworker.0 Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391363.485892:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1790391363.487219:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130806784:0@lo:400:kworker.0 00000100:00100000:0.0:1790391363.487583:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130807424:0@lo:400:kworker.0 00000100:00100000:0.0:1790391363.487633:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391363.487693:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130807424 00000100:00100000:0.0:1790391363.487699:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130807424 00000100:00100000:0.0:1790391363.487753:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790391363.487762:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130807424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391363.487810:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130807424:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.487817:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1790391363.487836:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391363.487856:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130807424:0@lo:400:kworker.0 00000100:00100000:1.0:1790391363.649701:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.650558:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108785664 00000100:00100000:3.0:1790391363.650569:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108785664 00000100:00100000:3.0:1790391363.650688:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 156 00000100:00100000:3.0:1790391363.650699:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+42:11465:x1877361108785664:12345-192.168.201.8@tcp:101:stat.0 00010000:00010000:3.0:1790391363.650723:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391363.650743:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b1c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff15 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.650806:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.650821:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.650832:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.650858:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.650866:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.650873:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.651237:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.651260:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.651281:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.651314:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391363.651327:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 43 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391363.651340:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130807552:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391363.651435:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241f1e9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391363.654506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391363.654635:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130807552:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391363.654669:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391363.655625:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108785920 00000100:00100000:0.0:1790391363.656411:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108785920 00000100:00100000:1.0:1790391363.656666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:1.0:1790391363.656678:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+44:5602:x1877361108785920:12345-192.168.201.8@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790391363.657276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+45:5602:x1877361108785920:12345-192.168.201.8@tcp:35:ldlm_bl.0 Request processed in 598us (2778us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1790391363.657285:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:3.0:1790391363.659870:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391363.660182:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108786048 00000100:00100000:0.0:1790391363.660192:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108786048 00010000:00010000:0.0:1790391363.660234:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 45 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391363.660278:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:0.0:1790391363.660288:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+45:2363:x1877361108786048:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391363.660303:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391363.660311:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 45 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.660324:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 45 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.660361:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1af lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff0e expref: 45 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.660377:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391363.660383:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.660393:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.660401:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.660428:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391363.660784:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660794:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391363.660839:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790391363.660854:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391363.660875:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660888:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660910:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660918:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660925:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660931:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391363.660935:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660942:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660952:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:1.0:1790391363.660955:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391363.660959:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660965:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b1cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660977:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660984:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.660990:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.661001:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391363.661004:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.661009:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.661057:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962411373c00) 00010000:00010000:1.0:1790391363.661059:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391363.661063:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.661069:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b1d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.661523:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b1c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff15 expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.661540:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff15 expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.661546:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391363.661549:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391363.661551:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3800, rc 0) 00000100:00100000:0.0:1790391363.661765:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+44:2363:x1877361108786048:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 1477us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.661774:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:1.0:1790391363.661905:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+43:11465:x1877361108785664:12345-192.168.201.8@tcp:101:stat.0 Request processed in 11209us (12213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391363.661912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 156 00000100:00100000:3.0:1790391363.717257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391363.717995:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108786304 00000100:00100000:0.0:1790391363.718006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108786304 00000100:00100000:0.0:1790391363.718105:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 157 00000100:00100000:0.0:1790391363.718114:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+43:11471:x1877361108786304:12345-192.168.201.8@tcp:36:truncate.0 00010000:00010000:0.0:1790391363.718177:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391363.718205:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b1d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff15 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.718224:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391363.718229:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391363.718456:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.718471:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.718481:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391363.718529:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1790391363.718552:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c3adce4 reply state 00000000f683ac46 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391363.718561:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391363.718662:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+45:11471:x1877361108786304:12345-192.168.201.8@tcp:36:truncate.0 Request processed in 547us (1423us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1790391363.718671:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 157 00000020:00080000:0.0:1790391363.718676:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790391363.720556:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.720572:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.720578:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.720584:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391363.720589:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.720596:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.720628:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391363.720631:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391363.720635:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391363.720642:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b1e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391363.863572:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.863618:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391363.863684:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108786432 00000100:00100000:1.0:1790391363.863709:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108786432 00000100:00100000:2.0:1790391363.863724:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108786560 00000100:00100000:2.0:1790391363.863731:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108786560 00000100:00100000:1.0:1790391363.863773:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 295 00000100:00100000:1.0:1790391363.863787:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108786432:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391363.863795:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00100000:2.0:1790391363.863805:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108786560:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391363.863929:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2363:x1877361108786432:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391363.863938:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 295 00000100:00080000:0.0:1790391363.864088:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391363.864540:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108786560:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 734us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391363.864548:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00100000:2.0:1790391363.881093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391363.881335:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391363.882250:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108786816 00000100:00100000:3.0:1790391363.882263:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108786816 00000100:00100000:3.0:1790391363.882351:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 157 00000100:00100000:3.0:1790391363.882364:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108786816:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391363.882456:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2364:x1877361108786816:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 96us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391363.882464:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 157 00000100:00100000:0.0:1790391363.885047:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108786688 00000100:00100000:0.0:1790391363.885065:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108786688 00000100:00100000:0.0:1790391363.885146:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:0.0:1790391363.885157:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108786688:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:0.0:1790391363.885400:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108786688:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 244us (4319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.885408:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:2.0:1790391363.897158:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391363.897791:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108786944 00000100:00100000:1.0:1790391363.897803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108786944 00000100:00100000:1.0:1790391363.897871:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 158 00000100:00100000:1.0:1790391363.897881:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+44:11485:x1877361108786944:12345-192.168.201.8@tcp:101:stat.0 00010000:00010000:1.0:1790391363.897905:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391363.897925:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b1e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff1c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.897987:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898001:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898229:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898492:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898502:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898510:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898612:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898622:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898628:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391363.898667:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1790391363.898911:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391363.898939:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898951:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898960:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898966:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898973:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898979:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391363.898983:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.898990:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.899011:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:1.0:1790391363.899035:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391363.900821:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.900838:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b1ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.900969:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.900976:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.900983:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.900989:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391363.900992:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.901000:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.901012:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9624119e7a00) 00010000:00010000:1.0:1790391363.901121:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391363.901125:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.901132:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b1f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.901201:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b1e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.901216:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391363.901223:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391363.901226:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391363.901229:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31e00, rc 0) 00000100:00100000:1.0:1790391363.901862:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+45:11485:x1877361108786944:12345-192.168.201.8@tcp:101:stat.0 Request processed in 3978us (4709us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391363.901872:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 158 00010000:00010000:1.0:1790391363.929592:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391364.016770:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.017367:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108787200 00000100:00100000:0.0:1790391364.017377:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108787200 00000100:00100000:0.0:1790391364.017502:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 159 00000100:00100000:0.0:1790391364.017515:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+45:11495:x1877361108787200:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391364.017535:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391364.017555:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff23 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391364.017651:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790391364.017781:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b203 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff23 expref: 47 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.017819:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:0.0:1790391364.017822:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391364.017828:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff23 expref: 47 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.017844:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979000, rc 0) 00000100:00100000:0.0:1790391364.017912:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+46:11495:x1877361108787200:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 400us (1155us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1790391364.017920:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 159 00000100:00080000:2.0:1790391364.022820:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391364.027307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.027747:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108787456 00000100:00100000:0.0:1790391364.027757:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108787456 00000100:00100000:0.0:1790391364.027820:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:0.0:1790391364.027831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+46:11495:x1877361108787456:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391364.028106:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+47:11495:x1877361108787456:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 276us (810us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1790391364.028114:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:1.0:1790391364.131000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391364.131147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108787712 00000100:00100000:2.0:1790391364.131159:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108787712 00000100:00100000:2.0:1790391364.131283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 160 00000100:00100000:2.0:1790391364.131295:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+47:11501:x1877361108787712:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391364.131334:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391364.131356:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b211 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff2a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.131464:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.131479:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.131509:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.131543:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.131558:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 48 pid: 5836 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391364.131586:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa71180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130807680:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391364.131692:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be236c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391364.135088:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa71180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130807680:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391364.135121:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391364.144133:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.144346:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108787840 00000100:00100000:0.0:1790391364.144357:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108787840 00010000:00010000:0.0:1790391364.144416:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 49 pid: 5836 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391364.144498:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:0.0:1790391364.144508:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+49:2363:x1877361108787840:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391364.144523:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391364.144530:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 49 pid: 5836 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.144561:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 49 pid: 5836 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.144586:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b1fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff1c expref: 49 pid: 5836 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.144604:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391364.144609:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.144618:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.144626:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.144659:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391364.144728:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+48:2363:x1877361108787840:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 220us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391364.144736:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 66 00010000:00010000:3.0:1790391364.145007:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.145055:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391364.145077:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1790391364.145269:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b211 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 49 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.145287:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.145295:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391364.145298:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790391364.145300:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10400, rc 0) 00000100:00100000:3.0:1790391364.145338:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+48:11501:x1877361108787712:12345-192.168.201.8@tcp:101:bash.0 Request processed in 14046us (14352us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1790391364.145346:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 160 00000100:00100000:2.0:1790391364.149996:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.150485:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108788096 00000100:00100000:3.0:1790391364.150496:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108788096 00000100:00100000:3.0:1790391364.150560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 161 00000100:00100000:3.0:1790391364.150572:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+48:11501:x1877361108788096:12345-192.168.201.8@tcp:36:bash.0 00010000:00010000:3.0:1790391364.150876:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.150894:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.150923:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391364.150980:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1790391364.151006:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428172bf reply state 00000000cc66d6d1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391364.151053:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391364.151516:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+51:11501:x1877361108788096:12345-192.168.201.8@tcp:36:bash.0 Request processed in 943us (1527us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1790391364.151526:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 161 00000020:00080000:3.0:1790391364.151530:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790391364.154889:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.154905:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.154913:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.154918:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.154923:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.154930:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.154947:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391364.154950:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391364.154970:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.154976:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b226 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391364.160372:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.160453:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108788224 00000100:00100000:0.0:1790391364.160463:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108788224 00000100:00100000:0.0:1790391364.160523:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 162 00000100:00100000:0.0:1790391364.160534:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+50:11501:x1877361108788224:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:0.0:1790391364.160560:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391364.160581:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b22d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff31 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.160713:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.160728:0:8292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.160736:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.160768:0:8292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.160782:0:8292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 51 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391364.160795:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411a1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130807808:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391364.160878:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a49ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391364.170947:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.171064:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108788352 00000100:00100000:3.0:1790391364.171074:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108788352 00010000:00010000:3.0:1790391364.171125:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 52 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391364.171160:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:3.0:1790391364.171170:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:2363:x1877361108788352:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391364.171590:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391364.171599:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 52 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.171614:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 52 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.171637:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391364.171642:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.171652:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.171659:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.171689:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391364.171754:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:2363:x1877361108788352:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 585us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391364.171762:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 67 00010000:00010000:0.0:1790391364.171964:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b218 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff2a expref: 51 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391364.171982:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411a1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130807808:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391364.172004:0:8292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.172039:0:8292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.172057:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391364.172103:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790391364.172107:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391364.172359:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.172391:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b22d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff31 expref: 51 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.172484:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff31 expref: 50 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.172493:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391364.172496:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391364.172499:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979c00, rc 0) 00000100:00100000:0.0:1790391364.172530:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+50:11501:x1877361108788224:12345-192.168.201.8@tcp:101:bash.0 Request processed in 11998us (12168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391364.172537:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 162 00000100:00100000:2.0:1790391364.177441:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.177685:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108788608 00000100:00100000:0.0:1790391364.177696:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108788608 00000100:00100000:0.0:1790391364.177798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:0.0:1790391364.177810:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+50:11501:x1877361108788608:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:0.0:1790391364.178078:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+51:11501:x1877361108788608:12345-192.168.201.8@tcp:35:bash.0 Request processed in 269us (646us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1790391364.178087:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:2.0:1790391364.269646:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.269990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108788864 00000100:00100000:3.0:1790391364.270000:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108788864 00000100:00100000:3.0:1790391364.270115:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 163 00000100:00100000:3.0:1790391364.270126:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+51:11511:x1877361108788864:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391364.270151:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391364.270173:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b23b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff38 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391364.270274:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790391364.270397:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b23b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff38 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.270411:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:3.0:1790391364.270415:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391364.270420:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b23b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff38 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.270434:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3600, rc 0) 00000100:00100000:3.0:1790391364.270495:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11511:x1877361108788864:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 372us (860us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1790391364.270502:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 163 00000100:00100000:2.0:1790391364.274306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.274389:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108788992 00000100:00100000:3.0:1790391364.274400:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108788992 00000100:00100000:3.0:1790391364.274466:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 164 00000100:00100000:3.0:1790391364.274477:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11511:x1877361108788992:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:3.0:1790391364.274573:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274591:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274603:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274619:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274627:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274634:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274722:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274731:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274738:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391364.274778:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274791:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274808:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274814:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274820:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.274824:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274832:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274859:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:3.0:1790391364.274861:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391364.274866:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274872:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274887:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274894:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274899:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274904:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.274912:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274928:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274936:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962411373400) 00010000:00010000:3.0:1790391364.274939:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391364.274942:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274948:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b250 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274964:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274979:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274985:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274990:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.274993:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.274998:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.275005:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391364.275007:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391364.275245:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.275253:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391364.275337:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11511:x1877361108788992:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 860us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391364.275346:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 164 00000100:00100000:2.0:1790391364.280647:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.280822:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108789248 00000100:00100000:1.0:1790391364.280834:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108789248 00000100:00100000:1.0:1790391364.280896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:1.0:1790391364.280906:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11511:x1877361108789248:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:1.0:1790391364.281208:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+53:11511:x1877361108789248:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 303us (570us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1790391364.281216:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:2.0:1790391364.315256:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.315345:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108789504 00000100:00100000:0.0:1790391364.315356:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108789504 00000100:00100000:0.0:1790391364.315415:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 165 00000100:00100000:0.0:1790391364.315427:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+53:11514:x1877361108789504:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391364.315459:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391364.315482:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b25e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff3f expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315559:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315575:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315587:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315603:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315612:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315620:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315737:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315747:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.315773:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391364.315784:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790391364.315960:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316137:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316145:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316150:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391364.316155:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316163:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316175:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391364.316178:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391364.316184:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316191:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979600/0x35e94fc15449b265 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316205:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316211:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316224:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316229:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391364.316242:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316249:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316257:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962430751c00) 00010000:00010000:0.0:1790391364.316259:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391364.316263:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316268:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b26c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316313:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b25e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff3f expref: 56 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316329:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff3f expref: 55 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.316337:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391364.316339:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391364.316342:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979800, rc 0) 00000100:00100000:0.0:1790391364.316408:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:11514:x1877361108789504:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 984us (1162us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1790391364.316427:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 165 00000100:00100000:2.0:1790391364.320815:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391364.324358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.324485:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108789760 00000100:00100000:0.0:1790391364.324494:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108789760 00000100:00100000:0.0:1790391364.324559:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1790391364.324570:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:2365:x1877361108789760:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391364.324587:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391364.324609:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b273 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff3f expref: 55 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.324627:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391364.324632:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391364.324679:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:2365:x1877361108789760:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391364.324686:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:1.0:1790391364.325796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108789632 00000100:00100000:1.0:1790391364.325804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108789632 00000100:00100000:1.0:1790391364.325890:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 166 00000100:00100000:1.0:1790391364.325910:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:11514:x1877361108789632:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:1.0:1790391364.326225:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326251:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326263:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326292:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326298:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326305:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326311:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391364.326315:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326323:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326331:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:1.0:1790391364.326334:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391364.326338:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.326344:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391364.326413:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:11514:x1877361108789632:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 503us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391364.326420:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 166 00000100:00100000:2.0:1790391364.328788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.328867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108790016 00000100:00100000:1.0:1790391364.328877:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108790016 00000100:00100000:1.0:1790391364.328932:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:1.0:1790391364.328942:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:11514:x1877361108790016:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:1.0:1790391364.329517:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:11514:x1877361108790016:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 575us (736us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1790391364.329525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:2.0:1790391364.486306:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.486398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108790272 00000100:00100000:0.0:1790391364.486408:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108790272 00000100:00100000:0.0:1790391364.486471:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00100000:0.0:1790391364.486482:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:11533:x1877361108790272:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:0.0:1790391364.486504:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391364.486525:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b288 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff46 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.486624:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b28f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.486638:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b28f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.486659:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b28f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391364.486671:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790391364.486795:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b288 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff46 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.486812:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b28f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff46 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391364.486820:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:0.0:1790391364.486822:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790391364.486825:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979000, rc 0) 00000100:00100000:0.0:1790391364.486892:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11533:x1877361108790272:12345-192.168.201.8@tcp:101:cat.0 Request processed in 412us (596us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1790391364.486899:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00100000:2.0:1790391364.512004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.512193:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108790400 00000100:00100000:3.0:1790391364.512203:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108790400 00000100:00100000:3.0:1790391364.512276:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 168 00000100:00100000:3.0:1790391364.512287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11534:x1877361108790400:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391364.512313:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391364.512335:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b29d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff4d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.512428:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b2a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.512442:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.512455:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391364.512490:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790391364.512494:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391364.512516:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.512555:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b29d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff4d expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.512573:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b2a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff4d expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.512582:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:3.0:1790391364.512585:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391364.512590:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2e00, rc 0) 00000100:00100000:3.0:1790391364.512664:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11534:x1877361108790400:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 380us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391364.512671:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 168 00000100:00100000:2.0:1790391364.521340:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.521495:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108790784 00000100:00100000:0.0:1790391364.521506:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108790784 00000100:00100000:0.0:1790391364.521565:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1790391364.521576:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11534:x1877361108790784:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391364.521913:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11534:x1877361108790784:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 339us (583us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1790391364.521929:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1790391364.524613:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.524699:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108790912 00000100:00100000:3.0:1790391364.524708:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108790912 00000100:00100000:3.0:1790391364.524768:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:3.0:1790391364.524778:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11534:x1877361108790912:12345-192.168.201.8@tcp:103:lfs.0 00010000:00010000:3.0:1790391364.524793:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790391364.524817:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff31 expref: 59 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.524849:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b28f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff46 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.524862:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b13f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fef2 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.524890:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391364.524903:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391364.525365:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:11534:x1877361108790912:12345-192.168.201.8@tcp:103:lfs.0 Request processed in 586us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391364.525373:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:2.0:1790391364.528438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.528540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108791040 00000100:00100000:1.0:1790391364.528552:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108791040 00000100:00100000:1.0:1790391364.528613:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 169 00000100:00100000:1.0:1790391364.528622:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:11534:x1877361108791040:12345-192.168.201.8@tcp:58:lfs.0 00010000:00010000:1.0:1790391364.528753:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.528771:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.528784:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391364.529256:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1790391364.529421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:11534:x1877361108791040:12345-192.168.201.8@tcp:58:lfs.0 Request processed in 798us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391364.529430:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 169 00000100:00100000:2.0:1790391364.554743:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.554906:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108791168 00000100:00100000:1.0:1790391364.555260:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108791168 00000100:00100000:1.0:1790391364.555362:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 170 00000100:00100000:1.0:1790391364.555372:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:11536:x1877361108791168:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391364.555393:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391364.555413:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b2b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff54 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555479:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555494:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555505:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555520:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555527:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555533:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555626:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555635:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555661:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391364.555699:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790391364.555704:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391364.555722:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555733:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555741:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555747:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555754:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555760:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391364.555764:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555771:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555782:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:1.0:1790391364.555786:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391364.555791:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555807:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b2b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555822:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555828:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555847:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555854:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391364.555857:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555864:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555872:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9624119e7900) 00010000:00010000:1.0:1790391364.555874:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391364.555877:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.555884:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.556481:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b2b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 58 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.556503:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 57 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.556516:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9624119e7a00) 00010000:00010000:1.0:1790391364.556518:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391364.556521:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31600, rc 0) 00000100:00100000:1.0:1790391364.556590:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11536:x1877361108791168:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1218us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391364.556598:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 170 00000040:00080000:1.0:1790391364.891736:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391364.891747:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391364.891794:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790391364.891801:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391364.891928:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243fa75f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130807936:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391364.892078:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9623013e26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391364.899420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.899632:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243fa75f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130807936:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391364.899825:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108791296 00000100:00100000:3.0:1790391364.899833:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108791296 00000100:00100000:3.0:1790391364.899891:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:3.0:1790391364.899901:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11547:x1877361108791296:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790391364.899936:0:11443:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790391364.900070:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11547:x1877361108791296:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 170us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391364.900079:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:0.0:1790391364.906761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.906917:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108791424 00000100:00100000:3.0:1790391364.906928:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108791424 00000100:00100000:3.0:1790391364.907007:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00100000:3.0:1790391364.907049:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11547:x1877361108791424:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790391364.907127:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907143:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907157:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907182:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907190:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907197:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907234:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907244:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907250:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391364.907290:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790391364.907295:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391364.907307:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907318:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907325:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907332:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907350:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.907360:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907368:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907380:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:3.0:1790391364.907394:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391364.907400:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907407:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b2ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907419:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907425:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907430:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907435:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.907438:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907443:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907626:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff962411373a00) 00010000:00010000:3.0:1790391364.907629:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391364.907633:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907639:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907656:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907662:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907668:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907673:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.907676:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907682:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907688:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9624119e7a00) 00010000:00010000:3.0:1790391364.907691:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391364.907694:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.907699:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391364.907785:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11547:x1877361108791424:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 Request processed in 768us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391364.907793:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00100000:3.0:1790391364.910762:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.912034:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108791680 00000100:00100000:1.0:1790391364.912061:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108791680 00000100:00100000:1.0:1790391364.912152:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 173 00000100:00100000:1.0:1790391364.912166:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11547:x1877361108791680:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391364.912195:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391364.912238:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b2e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff5b expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912391:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912412:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912443:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391364.912460:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790391364.912629:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912637:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912645:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912651:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391364.912666:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912676:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912691:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9624119e7a00) 00010000:00010000:1.0:1790391364.912695:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391364.912701:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912709:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b2ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912772:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b2e3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff5b expref: 59 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912796:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:1.0:1790391364.912799:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391364.912804:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b2e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff5b expref: 59 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.912815:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30000, rc 0) 00000100:00100000:1.0:1790391364.912906:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11547:x1877361108791680:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 743us (2157us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1790391364.912915:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 173 00000100:00100000:0.0:1790391364.924477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.924561:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108791808 00000100:00100000:1.0:1790391364.924572:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108791808 00000100:00100000:1.0:1790391364.924629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 174 00000100:00100000:1.0:1790391364.924638:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11547:x1877361108791808:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790391364.924672:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790391364.924769:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11547:x1877361108791808:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 132us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391364.924776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 174 00000100:00100000:2.0:1790391364.929137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.929285:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108792064 00000100:00100000:3.0:1790391364.929295:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108792064 00000100:00100000:3.0:1790391364.929360:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 175 00000100:00100000:3.0:1790391364.929371:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11547:x1877361108792064:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391364.929392:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391364.929395:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790391364.929421:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b2a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff4d expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.929441:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:3.0:1790391364.929447:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391364.929459:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff62 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391364.930194:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790391364.930417:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.930433:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.930444:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.930518:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b2f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff62 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.930535:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff62 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.930544:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff962411373a00) 00010000:00010000:3.0:1790391364.930547:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391364.930550:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3200, rc 0) 00000100:00100000:3.0:1790391364.930906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11547:x1877361108792064:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 1535us (1778us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1790391364.930916:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 175 00000100:00100000:1.0:1790391364.942302:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391364.942381:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108792320 00000100:00100000:2.0:1790391364.942391:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108792320 00000100:00100000:2.0:1790391364.942448:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 176 00000100:00100000:2.0:1790391364.942459:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11547:x1877361108792320:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391364.942517:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391364.942543:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b2ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff62 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942561:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff962411373a00) 00010000:00010000:2.0:1790391364.942573:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391364.942596:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942610:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942620:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942635:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942642:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942649:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942708:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942724:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942732:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942738:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391364.942743:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942751:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942759:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391364.942762:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391364.942766:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942773:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b30d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942782:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942788:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942794:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942800:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391364.942808:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942815:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942822:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x383476f2 (ffff96240bf85700) 00010000:00010000:2.0:1790391364.942838:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391364.942842:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391364.942848:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b314 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x383476f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391364.942932:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11547:x1877361108792320:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 475us (640us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790391364.942939:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 176 00000100:00100000:3.0:1790391364.946522:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.946614:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108792448 00000100:00100000:1.0:1790391364.946626:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108792448 00000100:00100000:1.0:1790391364.946686:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 177 00000100:00100000:1.0:1790391364.946697:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11547:x1877361108792448:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391364.946718:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391364.946743:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b31b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff69 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.946801:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.946814:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.946825:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.947054:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b31b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.947074:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.947083:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:1.0:1790391364.947086:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790391364.947090:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30e00, rc 0) 00000100:00100000:1.0:1790391364.947159:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11547:x1877361108792448:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 463us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391364.947167:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 177 00000100:00100000:2.0:1790391364.952677:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391364.955311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108792704 00000100:00100000:3.0:1790391364.955330:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108792704 00000100:00100000:3.0:1790391364.955401:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 178 00000100:00100000:3.0:1790391364.955413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11547:x1877361108792704:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790391364.955501:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.955522:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.955535:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391364.955859:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1790391364.955879:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400289862564ns, next at 401289860346ns, rc = 0 00000004:00010000:3.0:1790391364.955979:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000888cca86 reply state 00000000ed825a9d transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391364.955988:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391364.956116:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11547:x1877361108792704:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 703us (3448us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1790391364.956123:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 178 00010000:00010000:2.0:1790391364.959464:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391364.968585:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.968633:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108792832 00000100:00100000:1.0:1790391364.968643:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108792832 00000100:00100000:1.0:1790391364.968698:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 179 00000100:00100000:1.0:1790391364.968708:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11547:x1877361108792832:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391364.968737:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391364.968773:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff70 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.968835:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.968850:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.968871:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:1.0:1790391364.968875:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391364.968880:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31c00, rc 0) 00000100:00100000:1.0:1790391364.968931:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11547:x1877361108792832:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 225us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391364.968939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 179 00010000:00010000:3.0:1790391364.969154:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.969163:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.969170:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.969175:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391364.969179:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.969186:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.969197:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:3.0:1790391364.969199:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790391364.969203:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391364.969209:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b329 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391364.975202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.975313:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108792960 00000100:00100000:1.0:1790391364.975324:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108792960 00000100:00100000:1.0:1790391364.975392:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:1.0:1790391364.975403:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2366:x1877361108792960:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790391364.975785:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2366:x1877361108792960:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 382us (592us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790391364.975794:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:1.0:1790391364.980334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.980431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108793216 00000100:00100000:0.0:1790391364.980442:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108793216 00000100:00100000:0.0:1790391364.980493:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:0.0:1790391364.980506:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11547:x1877361108793216:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790391364.980773:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11547:x1877361108793216:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 269us (446us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1790391364.980780:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:3.0:1790391364.992747:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391364.992830:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108793472 00000100:00100000:0.0:1790391364.992841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108793472 00000100:00100000:0.0:1790391364.992899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 180 00000100:00100000:0.0:1790391364.992910:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11547:x1877361108793472:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391364.993046:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11547:x1877361108793472:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 138us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391364.993054:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 180 00000100:00100000:3.0:1790391364.995159:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391364.995310:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108793600 00000100:00100000:1.0:1790391364.995320:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108793600 00000100:00100000:1.0:1790391364.995380:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 181 00000100:00100000:1.0:1790391364.995391:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11547:x1877361108793600:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391364.995418:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391364.995439:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b337 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff77 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.995516:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b33e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.995531:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.995543:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391364.995582:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391364.995600:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.995626:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449b337 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff77 expref: 64 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.995640:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff77 expref: 63 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391364.995648:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:1.0:1790391364.995650:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790391364.995654:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30000, rc 0) 00000100:00100000:1.0:1790391364.995711:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+63:11547:x1877361108793600:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 323us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391364.995718:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 181 00000100:00100000:0.0:1790391365.004147:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391365.007627:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108793728 00000100:00100000:2.0:1790391365.007641:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108793728 00000100:00100000:2.0:1790391365.007711:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:2.0:1790391365.007723:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108793728:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391365.007741:0:12080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391365.007763:0:12080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff7e expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391365.007793:0:12080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab73444, blocks: 0x1 00010000:00010000:2.0:1790391365.007810:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1790391365.007821:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391365.007830:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 8 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.007848:0:12080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 8 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.007862:0:12080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11000, rc 0) 00000100:00100000:2.0:1790391365.007927:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108793728:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 208us (3815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391365.007933:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00080000:0.0:1790391365.018788:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391365.029834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391365.029875:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108793984 00000100:00100000:0.0:1790391365.029884:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108793984 00000100:00100000:0.0:1790391365.029933:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 182 00000100:00100000:0.0:1790391365.029943:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+63:11547:x1877361108793984:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391365.030071:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+63:11547:x1877361108793984:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 128us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391365.030079:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 182 00000100:00100000:1.0:1790391365.040456:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391365.040591:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108794112 00000100:00100000:1.0:1790391365.040602:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108794112 00000100:00100000:1.0:1790391365.040656:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:1.0:1790391365.040667:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:11547:x1877361108794112:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391365.040688:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391365.040709:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff85 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.040742:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 9 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.040752:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391365.040756:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391365.040762:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.040800:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 9 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.040814:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 9 pid: 12080 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.040832:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1877361130808064:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391365.040916:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391365.060461:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1877361130808064:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391365.060502:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.060527:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e960c00, rc 0) 00000100:00100000:2.0:1790391365.060602:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:11547:x1877361108794112:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 19936us (20157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391365.060611:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:3.0:1790391365.066962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391365.067056:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108794240 00000100:00100000:1.0:1790391365.067073:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108794240 00010000:00010000:1.0:1790391365.067116:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 9 pid: 12080 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.067156:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:1.0:1790391365.067166:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108794240:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391365.067180:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391365.067203:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 9 pid: 12080 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.067217:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 9 pid: 12080 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.067252:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000498e78b5/0x35e94fc15449b345 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff7e expref: 9 pid: 12080 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.067269:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391365.067274:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391365.067282:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.067293:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.067329:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.067380:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439943800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1877361130808192:192.168.201.8@tcp:105: 00000100:00100000:1.0:1790391365.067828:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624397c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391365.074047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391365.074124:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108794368 00000100:00100000:0.0:1790391365.074142:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108794368 00002000:00100000:0.0:1790391365.074194:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff962439941c00 x1877361108794368/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:231/0 lens 504/0 e 0 to 0 dl 1790391376 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391365.074207:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962439941c00 with x1877361108794368 ext(0->8) 00002000:00010000:0.0:1790391365.074212:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962439941c00 00000100:00100000:0.0:1790391365.074259:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1790391365.074271:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108794368:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790391365.074704:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:2364:x1877361108794368:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 Request processed in 435us (697us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790391365.074713:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00002000:00100000:0.0:1790391365.074720:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff962439941c00 x1877361108794368/t4294967315(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:231/0 lens 504/448 e 0 to 0 dl 1790391376 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391365.074729:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962439941c00 with x1877361108794368 ext(0->8) 00002000:00010000:0.0:1790391365.074732:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962439941c00 00000100:00100000:3.0:1790391365.075285:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439943800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1877361130808192:192.168.201.8@tcp:105: 00010000:00010000:3.0:1790391365.075311:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391365.075350:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2364:x1877361108794240:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 8185us (8399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391365.075359:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:1.0:1790391365.081237:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391365.081331:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108794496 00000100:00100000:3.0:1790391365.081341:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108794496 00000100:00100000:3.0:1790391365.081403:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 183 00000100:00100000:3.0:1790391365.081415:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+63:11547:x1877361108794496:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790391365.123264:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1790391365.123290:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1790391365.175311:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1790391365.175348:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96243a49eb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1790391365.175353:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96242db74500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96243a49ecc0 00000020:00080000:2.0:1790391365.175356:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96242db74100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96243fb35400 00000004:00080000:2.0:1790391365.175397:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1790391365.175422:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1790391365.175477:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1790391365.176379:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790391365.176710:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11547:x1877361108794496:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 Request processed in 95292us (95492us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391365.176722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 183 00000100:00100000:0.0:1790391365.176884:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130808320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790391365.176945:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391365.177663:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130808320 00000100:00100000:3.0:1790391365.177673:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130808320 00000100:00100000:3.0:1790391365.177739:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790391365.177752:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130808320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790391365.177781:0:8917:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1790391365.177816:0:8917:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab73442, atime: 0x6ab73442, ctime: 0x6ab73442, blocks: 0xb 00010000:00010000:3.0:1790391365.177892:0:8917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.177927:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1790391365.177932:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391365.177938:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.177954:0:8917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.177964:0:8917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.177971:0:8917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.177990:0:8917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790391365.178328:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391365.178341:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130808448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790391365.178394:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391365.178430:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130808448 00000100:00100000:2.0:1790391365.178435:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130808448 00000100:00100000:2.0:1790391365.178465:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790391365.178472:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130808448:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1790391365.178939:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391365.178944:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391365.179438:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1877361130808320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1686us (2489us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790391365.179448:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1790391365.179483:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391365.179490:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.179503:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391365.179508:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391365.179995:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790391365.180000:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790391364 00002000:00010000:2.0:1790391365.180003:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790391365.180004:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790391364 -> 1790391364 00002000:00010000:2.0:1790391365.180007:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790391365.180064:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1877361130808448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1591us (1668us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790391365.180072:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:2.0:1790391365.180127:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96243f723b80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1790391365.180133:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130808448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790391365.181763:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1790391365.181772:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1790391365.181796:0:3310:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff96243f721c00 x1877361130808320/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790391381 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790391365.181808:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96243f721c00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1790391365.181814:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130808320:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1790391365.184341:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.184386:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.184396:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018184a2a/0x35e94fc15449b353 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.184428:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391365.184431:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391365.184434:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391365.186236:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391365.186465:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108794624 00000100:00100000:3.0:1790391365.186476:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108794624 00000100:00100000:3.0:1790391365.186544:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:3.0:1790391365.186556:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2363:x1877361108794624:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790391365.263107:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1790391365.263377:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:3.0:1790391365.263522:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108794624:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 Request processed in 76963us (77286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391365.263960:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:0.0:1790391365.265914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391365.265993:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108794880 00000100:00100000:3.0:1790391365.266003:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108794880 00000100:00100000:3.0:1790391365.266086:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 184 00000100:00100000:3.0:1790391365.266096:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11547:x1877361108794880:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790391365.266152:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391365.266180:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449b33e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff77 expref: 18 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.266212:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:3.0:1790391365.266227:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391365.266258:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.266271:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.266280:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391365.266597:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0185abe reply state 000000001db3d58c transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391365.266608:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391365.266699:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:11547:x1877361108794880:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 604us (792us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1790391365.266707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 184 00010000:00010000:3.0:1790391365.270402:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.270420:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.270427:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.270433:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391365.270438:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.270454:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.270472:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:3.0:1790391365.270475:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391365.270480:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.270486:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b35a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391365.271957:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391365.272076:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108795008 00000100:00100000:3.0:1790391365.272087:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108795008 00000100:00100000:3.0:1790391365.272139:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:3.0:1790391365.272149:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108795008:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790391365.272417:0:12080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790391365.272422:0:12080:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790391364 -> 1790391363 00002000:00010000:3.0:1790391365.272424:0:12080:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790391362 00002000:00010000:3.0:1790391365.272427:0:12080:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790391364 -> 1790391363 00002000:00010000:3.0:1790391365.272429:0:12080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790391365.272497:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108795008:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 349us (549us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1790391365.272504:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:1.0:1790391365.276416:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391365.276548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108795264 00000100:00100000:0.0:1790391365.276559:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108795264 00000100:00100000:0.0:1790391365.276620:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 185 00000100:00100000:0.0:1790391365.276631:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11547:x1877361108795264:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790391365.276702:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.276720:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.276729:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.276767:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.276780:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 18 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391365.276795:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130808576:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391365.276904:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e34840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391365.301835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391365.301916:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108795392 00000100:00100000:3.0:1790391365.301927:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108795392 00010000:00010000:3.0:1790391365.301971:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 19 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391365.302055:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 69 00000100:00100000:3.0:1790391365.302066:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240312e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:2363:x1877361108795392:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391365.302082:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391365.302089:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 19 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.302103:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 19 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.302134:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:3.0:1790391365.302140:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.302150:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.302157:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.302177:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391365.302240:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240312e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:2363:x1877361108795392:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 176us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391365.302246:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 69 00010000:00010000:0.0:1790391365.302625:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30e00/0x35e94fc15449b322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff69 expref: 18 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391365.302646:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130808576:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391365.302677:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302687:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302692:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302725:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302732:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302739:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302744:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391365.302748:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302756:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302766:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:0.0:1790391365.302769:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790391365.302772:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.302779:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b361 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391365.302848:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:11547:x1877361108795264:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 Request processed in 26218us (26441us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790391365.302857:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 185 00000100:00100000:1.0:1790391365.304867:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391365.304946:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108795520 00000100:00100000:3.0:1790391365.304955:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108795520 00000100:00100000:3.0:1790391365.305042:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:3.0:1790391365.305052:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108795520:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790391365.305106:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.305125:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.305133:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391365.305137:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391365.305142:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.305175:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.305188:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 8 pid: 6697 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391365.305203:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130808704:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391365.305285:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411d93840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391365.308534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391365.308599:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108795648 00000100:00100000:1.0:1790391365.308609:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108795648 00010000:00010000:1.0:1790391365.308650:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 9 pid: 6697 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.308697:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 70 00000100:00100000:1.0:1790391365.308708:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108795648:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391365.308723:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391365.308750:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 9 pid: 6697 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.308766:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 9 pid: 6697 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.308793:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391365.308798:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391365.308804:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.308834:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.308858:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391365.308907:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108795648:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 200us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391365.308914:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 70 00010000:00010000:3.0:1790391365.311694:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b34c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff85 expref: 8 pid: 6697 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391365.311716:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130808704:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391365.311742:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311768:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311776:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311811:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311821:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311831:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311839:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391365.311844:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311854:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311873:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391365.311893:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018184a2a/0x35e94fc15449b368 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391365.311996:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108795520:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 Request processed in 6943us (7134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391365.312005:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:0.0:1790391365.330099:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391365.330187:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108795904 00000100:00100000:2.0:1790391365.330197:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108795904 00000100:00100000:2.0:1790391365.330261:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 186 00000100:00100000:2.0:1790391365.330272:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+17:11547:x1877361108795904:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790391365.330359:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.330391:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.330404:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.330631:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.330643:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.330651:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.330688:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.330701:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 18 pid: 5836 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391365.330716:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f720700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130808832:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391365.330796:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be23e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391365.348538:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391365.349979:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f720700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130808832:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391365.350008:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391365.350107:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108796032 00000100:00100000:2.0:1790391365.350119:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108796032 00010000:00010000:2.0:1790391365.350152:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 19 pid: 5836 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391365.350181:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 71 00000100:00100000:2.0:1790391365.350189:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:2364:x1877361108796032:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391365.350202:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391365.350208:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 19 pid: 5836 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.350234:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 19 pid: 5836 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.350254:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449b330 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff70 expref: 19 pid: 5836 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.350268:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:2.0:1790391365.350273:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.350281:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.350289:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.350350:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391365.350410:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:2364:x1877361108796032:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 220us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391365.350426:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 71 00010000:00010000:0.0:1790391365.357138:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.357155:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391365.357377:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1790391365.357541:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1790391365.357588:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1790391365.357690:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1877361130808960:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790391365.357760:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391365.357804:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e34cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391365.360439:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130808960 00000100:00100000:2.0:1790391365.360456:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130808960 00000100:00100000:2.0:1790391365.360528:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391365.360540:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1877361130808960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790391365.360675:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1877361130808960:12345-0@lo:1000:mdt00_002.0 Request processed in 137us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391365.360684:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391365.361385:0:5838:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1790391365.361395:0:5838:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96243f723b80, transno 4294967316 00000100:00100000:1.0:1790391365.361418:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1877361130808960:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1790391365.361969:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1790391365.362089:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1877361130809088:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790391365.362157:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391365.362185:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391365.362924:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130809088 00000100:00100000:0.0:1790391365.362932:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130809088 00000100:00100000:0.0:1790391365.362973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391365.362981:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1877361130809088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790391365.363206:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1877361130809088:12345-0@lo:1000:mdt00_002.0 Request processed in 225us (1047us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790391365.363224:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391365.363355:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1877361130809088:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790391365.363397:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363409:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363416:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363423:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391365.363436:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363444:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363460:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9624119e7900) 00010000:00010000:1.0:1790391365.363464:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391365.363469:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363475:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b376 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363511:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363518:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363524:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363529:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391365.363532:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363537:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363544:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9624119e7a00) 00010000:00010000:1.0:1790391365.363546:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391365.363555:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363560:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449b2ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363583:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363597:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 21 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363606:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363634:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 21 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.363647:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 21 pid: 8292 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.363661:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242db87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130809216:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391365.363728:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391365.384583:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391365.384854:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242db87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130809216:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391365.384882:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.385132:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108796160 00000100:00100000:1.0:1790391365.385140:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108796160 00010000:00010000:1.0:1790391365.385178:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 22 pid: 8292 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.385212:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:1.0:1790391365.385234:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:2363:x1877361108796160:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391365.385259:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391365.385267:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 22 pid: 8292 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.385281:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 22 pid: 8292 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.385303:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31600/0x35e94fc15449b2c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff54 expref: 22 pid: 8292 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.385318:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9624119e7a00) 00010000:00010000:1.0:1790391365.385322:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.385332:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.385340:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.385364:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391365.385409:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:2363:x1877361108796160:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 177us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391365.385417:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 72 00010000:00010000:2.0:1790391365.385625:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385634:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385647:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385656:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385663:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385669:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391365.385673:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385688:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385699:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9624119e7a00) 00010000:00010000:2.0:1790391365.385702:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391365.385707:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385713:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b37d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385725:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385731:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385738:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385743:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391365.385746:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385752:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385760:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9624119e7a00) 00010000:00010000:2.0:1790391365.385762:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391365.385766:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.385782:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b36f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391365.386038:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:11547:x1877361108795904:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 55746us (55927us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1790391365.386047:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 186 00000020:00080000:2.0:1790391365.386051:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790391365.386304:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391365.386309:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391365.386816:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1790391365.386825:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391365.391485:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391365.391572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108796416 00000100:00100000:2.0:1790391365.391583:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108796416 00000100:00100000:2.0:1790391365.391649:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:2.0:1790391365.391659:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:11547:x1877361108796416:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790391365.392430:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790391365.392537:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1790391365.392582:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392600:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392612:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392621:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392627:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392633:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392659:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790391365.392755:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:11547:x1877361108796416:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 1095us (1280us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1790391365.392764:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00000020:00080000:2.0:1790391365.392768:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790391365.392900:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391365.392906:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392914:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391365.392918:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392926:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392938:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff96240bf85400) 00010000:00010000:2.0:1790391365.392942:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790391365.392948:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392954:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b384 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391365.392970:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391365.392972:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391365.392974:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391365.532897:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391365.532948:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130809344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391365.533054:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391365.533233:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130809344 00000100:00100000:3.0:1790391365.533242:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130809344 00000100:00100000:3.0:1790391365.533304:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391365.533315:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130809344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391365.533340:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1790391365.533392:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130809344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391365.533399:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391365.533453:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130809344:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790391365.555003:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391365.555037:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391365.555094:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790391365.555103:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391365.764127:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391365.764263:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108796672 00000100:00100000:1.0:1790391365.764273:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108796672 00000100:00100000:1.0:1790391365.764336:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 187 00000100:00100000:1.0:1790391365.764346:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:11557:x1877361108796672:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391365.764533:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391365.764556:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b38b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff8c expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.764654:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960800/0x35e94fc15449b392 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.764668:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960800/0x35e94fc15449b392 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.764683:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960800/0x35e94fc15449b392 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391365.764694:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790391365.764839:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b38b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff8c expref: 25 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.764857:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960800/0x35e94fc15449b392 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff8c expref: 24 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.764865:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:1.0:1790391365.764868:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391365.764871:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e960800, rc 0) 00000100:00100000:1.0:1790391365.764969:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:11557:x1877361108796672:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 624us (853us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790391365.764976:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 187 00000100:00100000:3.0:1790391365.778698:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391365.778768:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108796800 00000100:00100000:0.0:1790391365.778778:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108796800 00000100:00100000:0.0:1790391365.778839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 188 00000100:00100000:0.0:1790391365.778850:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:11557:x1877361108796800:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:0.0:1790391365.778941:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.778961:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.778974:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.778989:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.778997:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779004:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779281:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779290:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779297:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391365.779338:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779352:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779369:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779606:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779612:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391365.779616:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779625:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779639:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391365.779642:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391365.779648:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779653:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779667:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779673:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779679:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779684:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391365.779695:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779701:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779709:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962430751e00) 00010000:00010000:0.0:1790391365.779712:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391365.779715:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779721:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779739:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779745:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779752:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779757:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391365.779760:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779766:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779773:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751c00) 00010000:00010000:0.0:1790391365.779775:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391365.779784:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.779790:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391365.779927:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:11557:x1877361108796800:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 1077us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391365.779936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 188 00000100:00100000:3.0:1790391365.869305:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391365.869520:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108797056 00000100:00100000:0.0:1790391365.869532:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108797056 00000100:00100000:0.0:1790391365.869587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 189 00000100:00100000:0.0:1790391365.869597:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:11560:x1877361108797056:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391365.869617:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391365.869637:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff93 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.869715:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.869730:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.869744:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.869759:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.869767:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.869790:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870080:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870089:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870097:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391365.870106:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790391365.870217:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870225:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870232:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870239:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391365.870243:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870251:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870263:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391365.870267:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391365.870278:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870285:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870309:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870316:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870322:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870327:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391365.870331:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870337:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870345:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962430751c00) 00010000:00010000:0.0:1790391365.870347:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391365.870350:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391365.870356:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979a00/0x35e94fc15449b3c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.874072:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978c00/0x35e94fc15449b3b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.874104:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.874114:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:1.0:1790391365.874117:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391365.874121:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978800, rc 0) 00000100:00100000:1.0:1790391365.874201:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11560:x1877361108797056:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 4604us (4918us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1790391365.874221:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 189 00000100:00100000:3.0:1790391365.882213:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391365.882316:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108797184 00000100:00100000:1.0:1790391365.882326:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108797184 00000100:00100000:1.0:1790391365.882393:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 190 00000100:00100000:1.0:1790391365.882403:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11560:x1877361108797184:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:1.0:1790391365.882478:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882498:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882511:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882540:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882562:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882570:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882577:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391365.882582:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882591:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882603:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:1.0:1790391365.882607:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391365.882611:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391365.882619:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b3d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391365.882699:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11560:x1877361108797184:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 297us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391365.882707:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 190 00000100:00100000:3.0:1790391365.886673:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391365.887515:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108797440 00000100:00100000:2.0:1790391365.887527:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108797440 00000100:00100000:2.0:1790391365.887591:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:2.0:1790391365.887603:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11560:x1877361108797440:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:2.0:1790391365.887841:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:11560:x1877361108797440:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 240us (1175us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1790391365.887848:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 51 00010000:00010000:2.0:1790391365.992389:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391366.013936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391366.015145:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108797696 00000100:00100000:1.0:1790391366.015160:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108797696 00000100:00100000:1.0:1790391366.015248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 191 00000100:00100000:1.0:1790391366.015260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:11094:x1877361108797696:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391366.015283:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391366.015318:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b3df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ff9a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.015421:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.015437:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.015447:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.015482:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.015496:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 28 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391366.015511:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130809472:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391366.015603:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681bd80 going to sleep for 11 seconds 00000100:00080000:2.0:1790391366.015906:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391366.027546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.031576:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1877361130809472:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391366.031612:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.035270:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108797824 00000100:00100000:3.0:1790391366.035285:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108797824 00010000:00010000:3.0:1790391366.035338:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 29 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.035404:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00100000:3.0:1790391366.035415:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:2363:x1877361108797824:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391366.035432:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391366.035439:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 29 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.035452:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 29 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.035473:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff93 expref: 29 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.035486:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:3.0:1790391366.035492:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.035501:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.035508:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.035604:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391366.035672:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:2363:x1877361108797824:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 258us (8134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.035679:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 73 00010000:00010000:2.0:1790391366.036232:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.036241:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391366.036260:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790391366.036511:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b3df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.036535:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.036543:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:3.0:1790391366.036546:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790391366.036549:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e961a00, rc 0) 00000100:00100000:3.0:1790391366.036623:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:11094:x1877361108797696:12345-192.168.201.8@tcp:101:bash.0 Request processed in 21366us (22700us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1790391366.036632:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 191 00000100:00100000:2.0:1790391366.048681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391366.048751:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108798080 00000100:00100000:0.0:1790391366.048761:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108798080 00000100:00100000:0.0:1790391366.048829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 192 00000100:00100000:0.0:1790391366.048853:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:11094:x1877361108798080:12345-192.168.201.8@tcp:36:bash.0 00010000:00010000:0.0:1790391366.049495:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.049513:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.049525:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391366.049577:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1790391366.049604:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b386065a reply state 000000009bbbdf77 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391366.049613:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790391366.049662:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1790391366.049764:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:11094:x1877361108798080:12345-192.168.201.8@tcp:36:bash.0 Request processed in 913us (1092us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1790391366.049773:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 192 00000020:00080000:0.0:1790391366.049778:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1790391366.051942:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.051959:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.051966:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.051988:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.051993:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.052001:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.052046:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:2.0:1790391366.052050:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391366.052055:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.052062:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b3f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.052304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.052512:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108798208 00000100:00100000:3.0:1790391366.052522:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108798208 00000100:00100000:3.0:1790391366.052569:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 193 00000100:00100000:3.0:1790391366.052579:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:11094:x1877361108798208:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:3.0:1790391366.052604:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391366.052620:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b3fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffa1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.052671:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b3fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa1 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.052684:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b3fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa1 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.052704:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:3.0:1790391366.052707:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391366.052718:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2e00, rc 0) 00000100:00100000:3.0:1790391366.052771:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:11094:x1877361108798208:12345-192.168.201.8@tcp:101:bash.0 Request processed in 193us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.052777:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 193 00000100:00100000:3.0:1790391366.061145:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391366.061257:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108798336 00000100:00100000:1.0:1790391366.061268:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108798336 00000100:00100000:1.0:1790391366.061335:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:1.0:1790391366.061348:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:11094:x1877361108798336:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391366.061367:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391366.061398:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffa8 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391366.061455:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab73443, atime: 0x6ab73442, ctime: 0x6ab73443, blocks: 0xb 00010000:00010000:1.0:1790391366.061481:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1790391366.061486:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391366.061497:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.061516:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.061530:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e960000, rc 0) 00000100:00100000:1.0:1790391366.061600:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:11094:x1877361108798336:12345-192.168.201.8@tcp:101:bash.0 Request processed in 254us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391366.061608:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:3.0:1790391366.065998:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.066219:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108798464 00000100:00100000:2.0:1790391366.066229:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108798464 00002000:00010000:2.0:1790391366.066273:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1790391366.066278:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96243f684a80 with x1877361108798464 ext(0->18446744073709551615) 00002000:00010000:2.0:1790391366.066290:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96243f684a80. 00000100:00100000:2.0:1790391366.066323:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:2.0:1790391366.066333:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108798464:12345-192.168.201.8@tcp:10:bash.0 00002000:00010000:2.0:1790391366.066610:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790391366.066614:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790391363 -> 1790391365 00002000:00010000:2.0:1790391366.066617:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790391362 -> 1790391362 00002000:00010000:2.0:1790391366.066619:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790391363 -> 1790391365 00002000:00010000:2.0:1790391366.066622:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790391366.066698:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108798464:12345-192.168.201.8@tcp:10:bash.0 Request processed in 366us (709us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1790391366.066707:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00002000:00010000:2.0:1790391366.066711:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1790391366.066714:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96243f684a80 with x1877361108798464 ext(0->18446744073709551615) 00002000:00010000:2.0:1790391366.066718:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96243f684a80. 00000100:00100000:1.0:1790391366.159420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.159511:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108798592 00000100:00100000:3.0:1790391366.159522:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108798592 00000100:00100000:3.0:1790391366.159581:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 194 00000100:00100000:3.0:1790391366.159594:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:11574:x1877361108798592:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:3.0:1790391366.159669:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159685:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159696:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159707:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159712:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159716:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159918:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159937:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.159945:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391366.159990:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160001:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160007:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160054:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160061:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.160066:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160074:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160085:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:3.0:1790391366.160089:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391366.160093:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160098:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160113:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160117:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160121:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160123:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.160125:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160128:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160133:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962411373700) 00010000:00010000:3.0:1790391366.160134:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391366.160136:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160139:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160148:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160152:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160155:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160162:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.160163:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160167:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160171:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:3.0:1790391366.160172:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391366.160174:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.160177:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.160534:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:11574:x1877361108798592:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 942us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.160544:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 194 00000100:00100000:3.0:1790391366.222973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.223198:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108798848 00000100:00100000:2.0:1790391366.223219:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108798848 00000100:00100000:2.0:1790391366.223279:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 195 00000100:00100000:2.0:1790391366.223290:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+32:11577:x1877361108798848:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391366.223310:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391366.223331:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b41e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffaf expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223400:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223414:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223427:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223440:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223448:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223454:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223704:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223714:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223721:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391366.223731:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790391366.223827:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223834:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223841:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223847:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.223852:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223859:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223870:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391366.223874:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391366.223879:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223894:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223907:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223913:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223919:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223925:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.223928:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223933:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223940:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96240bf85400) 00010000:00010000:2.0:1790391366.223942:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391366.223945:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223951:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b42c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223985:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b41e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffaf expref: 35 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.223997:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffaf expref: 34 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.224285:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:2.0:1790391366.224288:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790391366.224291:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11e00, rc 0) 00000100:00100000:2.0:1790391366.224355:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11577:x1877361108798848:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1066us (1391us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1790391366.224363:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 195 00000100:00100000:3.0:1790391366.228627:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391366.228727:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108798976 00000100:00100000:1.0:1790391366.228737:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108798976 00000100:00100000:1.0:1790391366.228798:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 196 00000100:00100000:1.0:1790391366.228819:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11577:x1877361108798976:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:1.0:1790391366.228893:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.228913:0:11443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.228934:0:11443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.228982:0:11443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.228997:0:11443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 34 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391366.229053:0:11443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130809600:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391366.229133:0:11443:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391366.236225:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.236302:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108799232 00000100:00100000:2.0:1790391366.236312:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108799232 00000100:00100000:2.0:1790391366.236380:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:2.0:1790391366.236391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:5602:x1877361108799232:12345-192.168.201.8@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790391366.236729:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:5602:x1877361108799232:12345-192.168.201.8@tcp:35:ldlm_bl.0 Request processed in 339us (530us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1790391366.236738:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:3.0:1790391366.237324:0:11443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130809600:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391366.237353:0:11443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.244700:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.244817:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108799360 00000100:00100000:2.0:1790391366.244828:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108799360 00010000:00010000:2.0:1790391366.244871:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 36 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.244916:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 74 00000100:00100000:2.0:1790391366.244936:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:2363:x1877361108799360:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391366.244952:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391366.244959:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 36 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.244974:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 36 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.245315:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b3e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff9a expref: 36 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.245334:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:2.0:1790391366.245340:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.245351:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.245360:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.245434:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391366.245489:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:2363:x1877361108799360:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 553us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391366.245496:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 74 00010000:00010000:3.0:1790391366.250849:0:11443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250867:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250927:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250935:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250943:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250949:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.250953:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250962:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250978:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:3.0:1790391366.250981:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391366.250985:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.250991:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.251306:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11577:x1877361108798976:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 22494us (22683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.251316:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 196 00000100:00100000:3.0:1790391366.253739:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.254715:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108799616 00000100:00100000:2.0:1790391366.254726:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108799616 00000100:00100000:2.0:1790391366.254776:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:2.0:1790391366.254785:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+34:11577:x1877361108799616:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:2.0:1790391366.255476:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:11577:x1877361108799616:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 689us (1743us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790391366.255486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:1.0:1790391366.400316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.400400:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108799872 00000100:00100000:3.0:1790391366.400410:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108799872 00000100:00100000:3.0:1790391366.400487:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 197 00000100:00100000:3.0:1790391366.400496:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+35:11588:x1877361108799872:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:3.0:1790391366.400519:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391366.400541:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b448 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffb6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400617:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400636:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400651:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400665:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400671:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400677:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400895:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b45d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400902:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.400907:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391366.400932:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790391366.401066:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401072:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401077:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401080:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.401084:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401089:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401108:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:3.0:1790391366.401110:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391366.401114:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401118:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b44f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401127:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401131:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401141:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401144:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.401146:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401149:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401154:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962411373700) 00010000:00010000:3.0:1790391366.401155:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391366.401156:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401160:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401190:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffb6 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401212:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b45d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffb6 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.401220:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:3.0:1790391366.401222:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391366.401225:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2800, rc 0) 00000100:00100000:3.0:1790391366.401286:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:11588:x1877361108799872:12345-192.168.201.8@tcp:101:cat.0 Request processed in 790us (978us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1790391366.401301:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 197 00000100:00100000:1.0:1790391366.405649:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.405757:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108800128 00000100:00100000:2.0:1790391366.405768:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108800128 00000100:00100000:2.0:1790391366.405825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:2.0:1790391366.405856:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:11588:x1877361108800128:12345-192.168.201.8@tcp:35:cat.0 00000100:00100000:2.0:1790391366.406181:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+38:11588:x1877361108800128:12345-192.168.201.8@tcp:35:cat.0 Request processed in 328us (542us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1790391366.406189:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 54 00000100:00100000:1.0:1790391366.460868:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.460976:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108800384 00000100:00100000:2.0:1790391366.460987:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108800384 00000100:00100000:2.0:1790391366.461078:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 198 00000100:00100000:2.0:1790391366.461089:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+38:11589:x1877361108800384:12345-192.168.201.8@tcp:36:rm.0 00010000:00010000:2.0:1790391366.461149:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790391366.461180:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b45d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffb6 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461213:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffaf expref: 37 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461235:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b3fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa1 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461245:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff962430751e00) 00010000:00010000:2.0:1790391366.461256:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391366.461279:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461303:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461313:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461344:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461351:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461357:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461727:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461735:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.461742:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391366.462332:0:8292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1790391366.462342:0:8292:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401796326003ns, next at 402796323786ns, rc = 0 00010000:00010000:2.0:1790391366.462649:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462660:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462668:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462675:0:8292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462694:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462699:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462784:0:8292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391366.462819:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462825:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462832:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462837:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.462842:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462850:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462860:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:2.0:1790391366.462863:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790391366.462867:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462873:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b479 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462890:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462902:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462908:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462914:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.462928:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462935:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462942:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391366.462945:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391366.462948:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.462953:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b46b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391366.462962:0:8292:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008da5eee4 reply state 00000000e2df5beb transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.462971:0:8292:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391366.463083:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+37:11589:x1877361108800384:12345-192.168.201.8@tcp:36:rm.0 Request processed in 1994us (2223us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790391366.463092:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 198 00010000:00010000:3.0:1790391366.465224:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.465239:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.465245:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.465251:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.465255:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.465262:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.465277:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96240bf85400) 00010000:00010000:3.0:1790391366.465281:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391366.465297:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.465303:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b472 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.473338:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391366.473357:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.473569:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391366.473574:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.473584:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.473602:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96240bf85800) 00010000:00010000:0.0:1790391366.473623:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790391366.473629:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.473635:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b480 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.473660:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391366.473662:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391366.473664:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391366.530394:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.530557:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108800640 00000100:00100000:3.0:1790391366.530567:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108800640 00000100:00100000:3.0:1790391366.530632:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 199 00000100:00100000:3.0:1790391366.530643:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+36:11595:x1877361108800640:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:3.0:1790391366.530667:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391366.530704:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b487 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffbd expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.530832:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.530848:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.530859:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.530873:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.530880:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.530886:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391366.531663:0:11443:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790391366.531823:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.531835:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.531843:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.531877:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.531894:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.531901:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.531906:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391366.531910:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.532523:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.532540:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:3.0:1790391366.532543:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391366.532548:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.532555:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b48e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391366.532571:0:11443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d4b3771 reply state 000000005114825e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.532579:0:11443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790391366.532616:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b487 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 39 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.532631:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 38 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.532655:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373b00) 00010000:00010000:3.0:1790391366.532657:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391366.532660:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2e00, rc 0) 00000100:00100000:3.0:1790391366.532743:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+39:11595:x1877361108800640:12345-192.168.201.8@tcp:101:bash.0 Request processed in 2101us (2360us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790391366.532752:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 199 00000100:00100000:1.0:1790391366.537231:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.537350:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108800768 00000100:00100000:3.0:1790391366.537360:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108800768 00000100:00100000:3.0:1790391366.537442:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:3.0:1790391366.537458:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2364:x1877361108800768:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:3.0:1790391366.537475:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391366.537495:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffc4 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790391366.537521:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790391366.537540:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1790391366.537544:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391366.537554:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.537575:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.537589:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2800, rc 0) 00010000:00010000:2.0:1790391366.537647:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.537655:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108800768:12345-192.168.201.8@tcp:101:bash.0 Request processed in 204us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.537676:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 61 00010000:00010000:2.0:1790391366.537676:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.537684:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.537689:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.537695:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.537704:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.537719:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962411373700) 00010000:00010000:2.0:1790391366.537722:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391366.537726:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.537732:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b495 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790391366.537791:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391366.541619:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.541700:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108800896 00000100:00100000:3.0:1790391366.541711:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108800896 00000100:00100000:3.0:1790391366.541773:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:3.0:1790391366.541783:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:11595:x1877361108800896:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:3.0:1790391366.541811:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391366.541832:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffcb expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.541864:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.541873:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391366.541877:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391366.541883:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.541916:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.541928:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 7 pid: 6695 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.541943:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1877361130809728:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391366.542351:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408346000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391366.545937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391366.546067:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108801024 00000100:00100000:1.0:1790391366.546077:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108801024 00010000:00010000:1.0:1790391366.546115:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 8 pid: 6695 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391366.546151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 75 00000100:00100000:1.0:1790391366.546161:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108801024:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391366.546179:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391366.546219:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 8 pid: 6695 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.546254:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 8 pid: 6695 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.546279:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391366.546293:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391366.546303:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.546313:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.546347:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391366.546736:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5823:1877361130809856:192.168.201.8@tcp:105: 00000100:00100000:1.0:1790391366.546819:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b000 going to sleep for 11 seconds 00010000:00010000:3.0:1790391366.547287:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000778f4544/0x35e94fc15449b4aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffc4 expref: 8 pid: 6695 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.547304:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1877361130809728:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391366.547328:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.547340:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3200, rc 0) 00000100:00100000:3.0:1790391366.547389:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:11595:x1877361108800896:12345-192.168.201.8@tcp:101:bash.0 Request processed in 5608us (5782us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.547397:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:3.0:1790391366.549999:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d862a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5823:1877361130809856:192.168.201.8@tcp:105: 00010000:00010000:3.0:1790391366.550055:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391366.550114:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2363:x1877361108801024:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 3953us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.550125:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 75 00000100:00100000:2.0:1790391366.554662:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391366.554865:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108801280 00000100:00100000:0.0:1790391366.554874:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108801280 00000100:00100000:0.0:1790391366.554922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:0.0:1790391366.554933:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+38:11595:x1877361108801280:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:0.0:1790391366.558645:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+39:11595:x1877361108801280:12345-192.168.201.8@tcp:35:bash.0 Request processed in 3704us (3985us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1790391366.558659:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 55 00000100:00100000:2.0:1790391366.699471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.701360:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108801408 00000100:00100000:3.0:1790391366.701477:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108801408 00000100:00100000:3.0:1790391366.701614:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 200 00000100:00100000:3.0:1790391366.701626:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+39:11611:x1877361108801408:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391366.701652:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391366.701677:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b4b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffd2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.701745:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b4bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.701777:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b4bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.701791:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b4bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391366.701828:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790391366.701833:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391366.701850:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b4bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.701876:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b4b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffd2 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.701896:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b4bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffd2 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.701904:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:3.0:1790391366.701908:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391366.701912:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2800, rc 0) 00000100:00100000:3.0:1790391366.704521:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:11611:x1877361108801408:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 2885us (5048us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.704665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 200 00000100:00100000:3.0:1790391366.708756:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.708896:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108801664 00000100:00100000:2.0:1790391366.708905:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108801664 00000100:00100000:2.0:1790391366.708976:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 201 00000100:00100000:2.0:1790391366.708986:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+40:11611:x1877361108801664:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391366.709053:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391366.709080:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b4c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffd9 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.709393:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b4cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.709411:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.709432:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b4cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391366.709447:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790391366.709710:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11800/0x35e94fc15449b4c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffd9 expref: 43 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.709729:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b4cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffd9 expref: 42 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.709738:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373b00) 00010000:00010000:2.0:1790391366.709741:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391366.709745:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11000, rc 0) 00000100:00100000:2.0:1790391366.709806:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+42:11611:x1877361108801664:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 821us (1061us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790391366.709814:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 201 00000100:00100000:2.0:1790391366.718542:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.718641:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391366.718741:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108802048 00000100:00100000:0.0:1790391366.718752:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108802048 00000100:00100000:0.0:1790391366.718823:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:0.0:1790391366.718834:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240312ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+42:2363:x1877361108802048:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391366.718849:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391366.718873:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b4cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffd9 expref: 42 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.718894:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373b00) 00010000:00010000:0.0:1790391366.718900:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391366.718990:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240312ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+41:2363:x1877361108802048:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 157us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391366.718997:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:3.0:1790391366.720907:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108801920 00000100:00100000:3.0:1790391366.721114:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108801920 00000100:00100000:1.0:1790391366.721505:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 202 00000100:00100000:1.0:1790391366.721516:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242db87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+41:11611:x1877361108801920:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391366.721539:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391366.721562:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961200/0x35e94fc15449b4db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffe0 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.721655:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961800/0x35e94fc15449b4e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.721687:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961800/0x35e94fc15449b4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.721700:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961800/0x35e94fc15449b4e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391366.721714:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790391366.721918:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961200/0x35e94fc15449b4db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffe0 expref: 44 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.721938:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961800/0x35e94fc15449b4e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffe0 expref: 43 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.721947:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373b00) 00010000:00010000:1.0:1790391366.721949:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790391366.721954:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e961800, rc 0) 00000100:00100000:1.0:1790391366.722116:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242db87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+43:11611:x1877361108801920:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 601us (3595us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790391366.722124:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 202 00000100:00100000:2.0:1790391366.726976:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.727143:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108802176 00000100:00100000:3.0:1790391366.727153:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108802176 00000100:00100000:3.0:1790391366.727315:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:3.0:1790391366.727336:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+6:2364:x1877361108802176:12345-192.168.201.8@tcp:1:lfs.0 00010000:00010000:3.0:1790391366.727382:0:12080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.727403:0:12080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.727412:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790391366.727416:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391366.727421:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.727454:0:12080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.727468:0:12080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 6 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.727484:0:12080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d03f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12080:1877361130809984:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391366.727568:0:12080:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624083460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391366.730816:0:12080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d03f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12080:1877361130809984:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391366.730847:0:12080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.732280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391366.732365:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108802304 00000100:00100000:1.0:1790391366.732375:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108802304 00002000:00100000:1.0:1790391366.732423:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9624399be680 x1877361108802304/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:232/0 lens 504/0 e 0 to 0 dl 1790391377 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391366.732435:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399be680 with x1877361108802304 ext(0->8) 00010000:00010000:1.0:1790391366.732444:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 7 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.732477:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 7 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391366.732484:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9624399be680 00000100:00100000:1.0:1790391366.732516:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:1.0:1790391366.732525:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108802304:12345-192.168.201.8@tcp:4:lfs.0 00000100:00100000:1.0:1790391366.733057:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2365:x1877361108802304:12345-192.168.201.8@tcp:4:lfs.0 Request processed in 487us (739us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790391366.733067:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00002000:00100000:1.0:1790391366.733075:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9624399be680 x1877361108802304/t4294967308(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:232/0 lens 504/448 e 0 to 0 dl 1790391377 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391366.733084:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9624399be680 with x1877361108802304 ext(0->8) 00010000:00010000:1.0:1790391366.733089:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 9 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.733102:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 9 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391366.733109:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9624399be680 00000100:00100000:2.0:1790391366.736994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.737120:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108802432 00000100:00100000:3.0:1790391366.737131:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108802432 00010000:00010000:3.0:1790391366.737201:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 9 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391366.737240:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00100000:3.0:1790391366.737251:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2366:x1877361108802432:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391366.737267:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790391366.737287:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790391366.737290:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790391366 00002000:00010000:3.0:1790391366.737293:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790391366 00002000:00010000:3.0:1790391366.737294:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790391366 00010000:00010000:3.0:1790391366.737301:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 9 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.737314:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 9 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.737340:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002678ed01/0x35e94fc15449b4b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffcb expref: 9 pid: 6694 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.737357:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391366.737361:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391366.737377:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.737388:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.737435:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391366.737497:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2366:x1877361108802432:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 247us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.737505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 76 00010000:00010000:2.0:1790391366.737767:0:12080:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737784:0:12080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737821:0:12080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737830:0:12080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737839:0:12080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737846:0:12080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391366.737852:0:12080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737861:0:12080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737873:0:12080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.737880:0:12080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089bbb37e/0x35e94fc15449b4f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.737937:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108802176:12345-192.168.201.8@tcp:1:lfs.0 Request processed in 10605us (10970us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391366.737945:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:3.0:1790391366.742968:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.743085:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108802688 00000100:00100000:2.0:1790391366.743096:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108802688 00000100:00100000:2.0:1790391366.743154:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 56 00000100:00100000:2.0:1790391366.743174:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+43:11611:x1877361108802688:12345-192.168.201.8@tcp:35:lfs.0 00000004:00010000:2.0:1790391366.743250:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961800/0x35e94fc15449b4e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffe0 expref: 43 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391366.743494:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1790391366.743539:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1790391366.743837:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1790391366.743888:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.743902:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 47 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.743911:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.743942:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 47 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.743958:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 47 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.743989:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9624399bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1877361130810112:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391366.744115:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be23840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391366.749088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391366.749312:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108802816 00000100:00100000:0.0:1790391366.749321:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108802816 00010000:00010000:0.0:1790391366.749360:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 48 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391366.749402:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:0.0:1790391366.749411:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+48:2363:x1877361108802816:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391366.749426:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391366.749433:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 48 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.749447:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 48 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.749468:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373b00) 00010000:00010000:0.0:1790391366.749474:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.749483:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.749489:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.749509:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391366.749570:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+48:2363:x1877361108802816:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 160us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391366.749593:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 77 00010000:00010000:2.0:1790391366.750123:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b49c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffbd expref: 47 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.750142:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9624399bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1877361130810112:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391366.750244:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.750255:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.750262:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391366.750391:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1790391366.750603:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1790391366.750719:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9624399bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130810240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790391366.750773:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391366.750870:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391366.752108:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130810240 00000100:00100000:0.0:1790391366.752118:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130810240 00000100:00100000:1.0:1790391366.752365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391366.752375:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1877361130810240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790391366.752518:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1877361130810240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391366.752539:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391366.752620:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9624399bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130810240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790391366.753440:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1790391366.753524:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9624399bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130810368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790391366.753570:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391366.753642:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be23840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391366.753700:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130810368 00000100:00100000:1.0:1790391366.753707:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130810368 00000100:00100000:1.0:1790391366.753738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391366.753746:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1877361130810368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790391366.753961:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1877361130810368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (390us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790391366.753968:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391366.754261:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9624399bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1877361130810368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790391366.754326:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1790391366.754370:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.754380:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.754387:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.754393:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.754398:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.754407:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.754422:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373b00) 00010000:00010000:2.0:1790391366.754425:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790391366.754430:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.754437:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10c00/0x35e94fc15449b4f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391366.754597:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790391366.754690:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1790391366.754701:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402088685295ns, next at 403088683494ns, rc = 0 00000001:00080000:2.0:1790391366.754707:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1790391366.754736:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373b00) 00010000:00010000:2.0:1790391366.754740:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790391366.754752:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961800/0x35e94fc15449b4e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffe0 expref: 51 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391366.754971:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+50:11611:x1877361108802688:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 11808us (12013us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1790391366.754980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 56 00000020:00080000:2.0:1790391366.754984:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790391366.757950:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391366.758158:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108802944 00000100:00100000:3.0:1790391366.758272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108802944 00000100:00100000:3.0:1790391366.758347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 203 00000100:00100000:3.0:1790391366.758359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+50:11611:x1877361108802944:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391366.758383:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391366.758409:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b4fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffe7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.758470:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b4fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffe7 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.758484:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b4fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffe7 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391366.758502:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391366.758506:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391366.758510:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3200, rc 0) 00000100:00100000:3.0:1790391366.758603:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+51:11611:x1877361108802944:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 246us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391366.758611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 203 00000100:00100000:1.0:1790391366.766830:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391366.766942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108803200 00000100:00100000:0.0:1790391366.766952:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108803200 00000100:00100000:0.0:1790391366.767039:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:0.0:1790391366.767050:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+51:11611:x1877361108803200:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391366.767602:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11611:x1877361108803200:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 552us (780us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1790391366.767610:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 57 00000100:00100000:2.0:1790391366.845525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391366.845623:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108803328 00000100:00100000:1.0:1790391366.845635:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108803328 00000100:00100000:1.0:1790391366.845711:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 204 00000100:00100000:1.0:1790391366.845723:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11621:x1877361108803328:12345-192.168.201.8@tcp:34:lfs.0 00010000:00010000:1.0:1790391366.845819:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.845837:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.845848:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.845862:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.845869:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.845892:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846004:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846052:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846062:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391366.846104:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846117:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846124:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846131:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846137:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391366.846141:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846149:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846160:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:1.0:1790391366.846170:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391366.846174:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846181:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846206:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846213:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846219:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846224:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391366.846227:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846232:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846239:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9624119e7f00) 00010000:00010000:1.0:1790391366.846242:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391366.846245:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846250:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b50c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846265:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846276:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846282:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846287:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391366.846290:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846296:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846303:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391366.846305:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391366.846308:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.846313:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961000/0x35e94fc15449b513 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391366.846380:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11621:x1877361108803328:12345-192.168.201.8@tcp:34:lfs.0 Request processed in 658us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391366.846388:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 204 00000100:00100000:1.0:1790391366.884436:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391366.884543:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108803584 00000100:00100000:2.0:1790391366.884554:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108803584 00000100:00100000:2.0:1790391366.884616:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 205 00000100:00100000:2.0:1790391366.884628:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+52:11624:x1877361108803584:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391366.884651:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391366.884674:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b51a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1ffee expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884751:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884766:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884777:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884791:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884797:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884823:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884956:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884964:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.884972:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391366.884982:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790391366.885149:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885157:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885164:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885170:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.885174:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885182:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885223:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391366.885227:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391366.885240:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885246:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b521 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885261:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885267:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885273:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885279:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391366.885282:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885288:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885295:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96240bf85500) 00010000:00010000:2.0:1790391366.885298:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391366.885300:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885306:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885346:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b51a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 55 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885372:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 54 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391366.885380:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391366.885382:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391366.885385:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10600, rc 0) 00000100:00100000:2.0:1790391366.885449:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:11624:x1877361108803584:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 823us (1022us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1790391366.885457:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 205 00000100:00100000:2.0:1790391366.890655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391366.891387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108803712 00000100:00100000:1.0:1790391366.891400:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108803712 00000100:00100000:1.0:1790391366.891515:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 206 00000100:00100000:1.0:1790391366.891536:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:11624:x1877361108803712:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:1.0:1790391366.891625:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891645:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891658:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891687:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891694:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891701:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891708:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391366.891712:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891720:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891732:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391366.891735:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391366.891741:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391366.891747:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b53d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391366.891851:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:11624:x1877361108803712:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 317us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391366.891858:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 206 00000100:00100000:3.0:1790391366.894695:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391366.894839:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108803968 00000100:00100000:0.0:1790391366.894849:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108803968 00000100:00100000:0.0:1790391366.894910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:0.0:1790391366.894931:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+54:11624:x1877361108803968:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391366.895240:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:11624:x1877361108803968:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 320us (556us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1790391366.895249:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 58 00000100:00100000:3.0:1790391366.992970:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391366.993913:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108804224 00000100:00100000:0.0:1790391366.993938:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108804224 00000100:00100000:0.0:1790391366.994055:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 207 00000100:00100000:0.0:1790391366.994067:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:11634:x1877361108804224:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:0.0:1790391366.994096:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391366.994100:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790391366.994127:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b4bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffd2 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.994171:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391366.994177:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391366.994234:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449b544 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fff5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.994332:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.994347:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 55 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.994356:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.994392:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 55 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391366.994407:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 55 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391366.994422:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130810496:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391366.994704:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e34840 going to sleep for 11 seconds 00010000:00010000:2.0:1790391367.001370:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391367.003952:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1877361130810496:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391367.003982:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391367.005127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.005945:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108804352 00000100:00100000:0.0:1790391367.005957:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108804352 00010000:00010000:0.0:1790391367.006009:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 56 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.006164:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:0.0:1790391367.006176:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:2363:x1877361108804352:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391367.006200:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391367.006215:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 56 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.006229:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 56 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.006253:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b52f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffee expref: 56 pid: 11443 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.006271:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391367.006285:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.006294:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.006301:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.006334:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391367.006495:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.006505:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391367.006535:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790391367.006683:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979e00/0x35e94fc15449b544 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.006698:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.006719:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.006722:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391367.006725:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978600, rc 0) 00000100:00100000:2.0:1790391367.006786:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+56:11634:x1877361108804224:12345-192.168.201.8@tcp:101:bash.0 Request processed in 12721us (13827us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790391367.006803:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 207 00000100:00100000:0.0:1790391367.007114:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:2363:x1877361108804352:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 940us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.007122:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:3.0:1790391367.011258:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.011577:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108804608 00000100:00100000:2.0:1790391367.011588:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108804608 00000100:00100000:2.0:1790391367.011639:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 208 00000100:00100000:2.0:1790391367.011649:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+55:11634:x1877361108804608:12345-192.168.201.8@tcp:36:bash.0 00010000:00010000:2.0:1790391367.011962:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.011981:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.011994:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391367.012067:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1790391367.012092:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d595af76 reply state 00000000de584091 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.012101:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391367.012218:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11634:x1877361108804608:12345-192.168.201.8@tcp:36:bash.0 Request processed in 568us (969us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1790391367.012226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 208 00000020:00080000:2.0:1790391367.012245:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790391367.015911:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.015931:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.015938:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.015944:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391367.015949:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.015959:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.015977:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391367.015980:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391367.015995:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.016002:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b559 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391367.020699:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.021006:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108804736 00000100:00100000:1.0:1790391367.021050:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108804736 00000100:00100000:1.0:1790391367.021110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 209 00000100:00100000:1.0:1790391367.021134:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11634:x1877361108804736:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391367.021160:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391367.021182:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b560 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f1fffc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.021301:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.021317:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.021325:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.021662:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.021677:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 58 pid: 5838 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.021690:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130810624:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391367.021774:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391367.025752:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130810624:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391367.025786:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391367.027083:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.027328:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108804864 00000100:00100000:1.0:1790391367.027340:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108804864 00010000:00010000:1.0:1790391367.027403:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 59 pid: 5838 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.027439:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 79 00000100:00100000:1.0:1790391367.027449:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:2364:x1877361108804864:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391367.027464:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391367.027471:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 59 pid: 5838 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.027485:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 59 pid: 5838 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.027510:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978600/0x35e94fc15449b54b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fff5 expref: 59 pid: 5838 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.027538:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391367.027544:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.027553:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.027563:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.027598:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391367.027655:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:2364:x1877361108804864:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 207us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.027663:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 79 00010000:00010000:2.0:1790391367.027808:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.027818:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391367.027867:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790391367.027873:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391367.027897:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.027932:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961a00/0x35e94fc15449b560 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.027949:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.027957:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.027960:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391367.027962:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e961c00, rc 0) 00000100:00100000:2.0:1790391367.027989:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11634:x1877361108804736:12345-192.168.201.8@tcp:101:bash.0 Request processed in 6856us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.027996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 209 00000100:00100000:3.0:1790391367.032620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.033416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108805120 00000100:00100000:0.0:1790391367.033438:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108805120 00000100:00100000:0.0:1790391367.033539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:0.0:1790391367.033550:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+57:11634:x1877361108805120:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:0.0:1790391367.033803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11634:x1877361108805120:12345-192.168.201.8@tcp:35:bash.0 Request processed in 254us (1191us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1790391367.033811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 59 00000100:00100000:3.0:1790391367.105426:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.105686:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108805248 00000100:00100000:2.0:1790391367.105697:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108805248 00000100:00100000:2.0:1790391367.105763:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 210 00000100:00100000:2.0:1790391367.105773:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+58:11640:x1877361108805248:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391367.105797:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391367.105833:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b56e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20003 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.105912:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.105938:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.105951:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391367.105984:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790391367.105988:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391367.106005:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.106055:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b56e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20003 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.106075:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20003 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.106086:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391367.106089:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391367.106093:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11a00, rc 0) 00000100:00100000:2.0:1790391367.106213:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11640:x1877361108805248:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 440us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.106220:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 210 00000100:00100000:2.0:1790391367.115270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.115737:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108805376 00000100:00100000:0.0:1790391367.115748:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108805376 00000100:00100000:0.0:1790391367.115825:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 211 00000100:00100000:0.0:1790391367.115837:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11640:x1877361108805376:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391367.115861:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391367.115885:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b57c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2000a expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.115966:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.115992:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116006:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116062:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116071:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116078:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116179:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b591 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116200:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116208:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391367.116242:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790391367.116247:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391367.116265:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116624:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116636:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116643:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116650:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116657:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391367.116661:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116670:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116691:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391367.116694:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391367.116700:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116706:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b583 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116718:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116725:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116730:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116735:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391367.116738:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116743:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116750:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962430751c00) 00010000:00010000:0.0:1790391367.116752:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391367.116755:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116760:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979c00/0x35e94fc15449b58a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116802:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978e00/0x35e94fc15449b57c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2000a expref: 61 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116814:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2000a expref: 60 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.116822:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391367.116824:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391367.116826:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979800, rc 0) 00000100:00100000:0.0:1790391367.116945:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:11640:x1877361108805376:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1110us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.116952:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 211 00000100:00100000:0.0:1790391367.122115:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.122203:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108805504 00000100:00100000:2.0:1790391367.122213:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108805504 00000100:00100000:2.0:1790391367.122271:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:2.0:1790391367.122291:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:2366:x1877361108805504:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391367.122306:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391367.122334:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449b591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2000a expref: 60 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.122362:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.122367:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391367.122420:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:2366:x1877361108805504:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 132us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.122427:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:0.0:1790391367.126203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.126287:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108805760 00000100:00100000:2.0:1790391367.126297:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108805760 00000100:00100000:2.0:1790391367.126367:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 212 00000100:00100000:2.0:1790391367.126377:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11640:x1877361108805760:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391367.126400:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391367.126421:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20011 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.126569:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.126586:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.126596:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.126645:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.126657:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 60 pid: 5836 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.126675:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130810752:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391367.126778:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7f480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391367.134300:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1877361130810752:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391367.134341:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.135457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.135575:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108805888 00000100:00100000:1.0:1790391367.135586:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108805888 00010000:00010000:1.0:1790391367.135628:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 61 pid: 5836 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.135674:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 80 00000100:00100000:1.0:1790391367.135684:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:2363:x1877361108805888:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391367.135700:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391367.135707:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 61 pid: 5836 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.135720:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 61 pid: 5836 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.135742:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e961c00/0x35e94fc15449b567 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fffc expref: 61 pid: 5836 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.135760:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391367.135766:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.135776:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.135785:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.135810:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391367.135826:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.135833:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391367.135853:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:1.0:1790391367.135864:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:2363:x1877361108805888:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 181us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.135885:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 80 00010000:00010000:3.0:1790391367.136057:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.136073:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.136081:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391367.136083:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790391367.136086:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10e00, rc 0) 00000100:00100000:3.0:1790391367.136126:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:11640:x1877361108805760:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 9752us (9945us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1790391367.136134:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 212 00000100:00100000:0.0:1790391367.143327:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.143428:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108806144 00000100:00100000:1.0:1790391367.143440:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108806144 00000100:00100000:1.0:1790391367.143522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1790391367.143542:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240312d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:11640:x1877361108806144:12345-192.168.201.8@tcp:103:lfs.0 00010000:00010000:1.0:1790391367.143560:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391367.143585:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3200/0x35e94fc15449b4fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffe7 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.143604:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:1.0:1790391367.143610:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391367.143676:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240312d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11640:x1877361108806144:12345-192.168.201.8@tcp:103:lfs.0 Request processed in 144us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.143683:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1790391367.150560:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391367.150626:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108806272 00000100:00100000:3.0:1790391367.150639:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108806272 00000100:00100000:3.0:1790391367.150711:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 213 00000100:00100000:3.0:1790391367.150744:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11640:x1877361108806272:12345-192.168.201.8@tcp:58:lfs.0 00010000:00010000:3.0:1790391367.150996:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.151054:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.151070:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391367.153287:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1790391367.153494:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11640:x1877361108806272:12345-192.168.201.8@tcp:58:lfs.0 Request processed in 2747us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.153508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 213 00000100:00100000:3.0:1790391367.158392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.158510:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108806400 00000100:00100000:0.0:1790391367.158521:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108806400 00000100:00100000:0.0:1790391367.158677:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 214 00000100:00100000:0.0:1790391367.158688:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+59:11640:x1877361108806400:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:0.0:1790391367.158712:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391367.158734:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20018 expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.158806:0:8292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.158835:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 60 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.158855:0:8292:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.158869:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 60 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.158883:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391367.158886:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391367.158889:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 60 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.158896:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979000, rc 0) 00000100:00100000:0.0:1790391367.158999:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:11640:x1877361108806400:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 314us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.159005:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 214 00000040:00080000:1.0:1790391367.449767:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391367.449778:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391367.449839:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1790391367.449846:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391367.449968:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b53100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130810880:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391367.450100:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391367.455683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.455893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108806528 00000100:00100000:2.0:1790391367.455903:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108806528 00000100:00100000:2.0:1790391367.455964:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 215 00000100:00100000:2.0:1790391367.455974:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108806528:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790391367.456044:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790391367.456138:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108806528:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 166us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.456146:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 215 00000100:00100000:1.0:1790391367.456774:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b53100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130810880:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391367.459359:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.459544:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108806656 00000100:00100000:2.0:1790391367.459569:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108806656 00000100:00100000:2.0:1790391367.459632:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 216 00000100:00100000:2.0:1790391367.459643:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:11641:x1877361108806656:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790391367.459720:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459739:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459751:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459767:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459774:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459781:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459803:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459812:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459818:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391367.459858:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790391367.459863:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391367.459884:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459895:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459901:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459908:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459914:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.459918:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459925:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459936:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:2.0:1790391367.459939:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391367.459944:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459950:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459962:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459968:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459973:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459983:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.459986:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459992:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.459998:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff96240bf85500) 00010000:00010000:2.0:1790391367.460000:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391367.460003:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460009:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b5c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460084:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460091:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460095:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460100:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.460103:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460108:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460125:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.460127:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391367.460130:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.460136:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b5c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.460216:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:11641:x1877361108806656:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 Request processed in 575us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.460224:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 216 00000100:00100000:0.0:1790391367.463423:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.465178:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108806912 00000100:00100000:2.0:1790391367.465201:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108806912 00000100:00100000:2.0:1790391367.465271:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 217 00000100:00100000:2.0:1790391367.465282:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+60:11641:x1877361108806912:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391367.465301:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391367.465323:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2001f expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465424:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465441:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465455:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391367.465466:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790391367.465900:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465908:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465914:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465920:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.465924:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465932:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465944:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.465947:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391367.465952:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.465958:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b5d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.466002:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5d0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2001f expref: 62 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.466012:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:2.0:1790391367.466045:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391367.466049:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2001f expref: 62 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.466371:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11600, rc 0) 00000100:00100000:2.0:1790391367.466517:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108806912:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 1235us (3113us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1790391367.466526:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 217 00000100:00100000:3.0:1790391367.478240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.478437:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108807040 00000100:00100000:2.0:1790391367.478448:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108807040 00000100:00100000:0.0:1790391367.478860:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 218 00000100:00100000:0.0:1790391367.478876:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108807040:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391367.478919:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391367.479155:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108807040:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 282us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.479164:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 218 00000100:00100000:3.0:1790391367.486144:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.486397:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108807296 00000100:00100000:0.0:1790391367.486422:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108807296 00000100:00100000:0.0:1790391367.486479:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 219 00000100:00100000:0.0:1790391367.486554:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108807296:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391367.486574:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391367.486577:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790391367.486602:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20003 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.486624:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391367.486630:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391367.486642:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b5e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20026 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790391367.487841:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1790391367.488119:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b5ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.488137:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b5ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.488150:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b5ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.488231:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b5e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20026 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.488251:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b5ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20026 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.488276:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff962430751c00) 00010000:00010000:0.0:1790391367.488279:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391367.488282:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978000, rc 0) 00000100:00100000:0.0:1790391367.488445:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11641:x1877361108807296:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 1893us (2309us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1790391367.488454:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 219 00000100:00100000:3.0:1790391367.516915:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.517072:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108807552 00000100:00100000:2.0:1790391367.517082:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108807552 00000100:00100000:2.0:1790391367.517146:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 220 00000100:00100000:2.0:1790391367.517156:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11641:x1877361108807552:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391367.517222:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391367.517247:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b5ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20026 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517267:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff962430751c00) 00010000:00010000:2.0:1790391367.517280:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391367.517306:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517322:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517333:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517347:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517372:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517379:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517449:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517457:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517463:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517469:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.517473:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517492:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517501:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:2.0:1790391367.517504:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391367.517508:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517514:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b5fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517523:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517534:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517539:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517544:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.517548:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517553:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517561:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa9cd8a6b (ffff96240bf85500) 00010000:00010000:2.0:1790391367.517564:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391367.517567:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.517572:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b601 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa9cd8a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.517652:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108807552:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 497us (746us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790391367.517660:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 220 00000100:00100000:3.0:1790391367.527255:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.527570:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108807680 00000100:00100000:2.0:1790391367.527581:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108807680 00000100:00100000:2.0:1790391367.527640:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 221 00000100:00100000:2.0:1790391367.527649:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+61:11641:x1877361108807680:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391367.527670:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391367.527711:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b608 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2002d expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.529450:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.529469:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.529550:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.529676:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 63 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.529699:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 62 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.529710:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:2.0:1790391367.529774:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391367.529839:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11600, rc 0) 00000100:00100000:2.0:1790391367.530007:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11641:x1877361108807680:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 2357us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.530070:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 221 00000100:00100000:3.0:1790391367.537689:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.544038:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108807936 00000100:00100000:1.0:1790391367.544058:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108807936 00000100:00100000:1.0:1790391367.544162:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 222 00000100:00100000:1.0:1790391367.544174:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+62:11641:x1877361108807936:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391367.544318:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.544347:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.544361:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391367.550264:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1790391367.550284:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402884267975ns, next at 403884264147ns, rc = 0 00000004:00010000:1.0:1790391367.551528:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed7cd30e reply state 00000000e2d678ec transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.551543:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391367.551687:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+64:11641:x1877361108807936:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 7509us (14002us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1790391367.551697:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 222 00010000:00010000:2.0:1790391367.554966:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.554992:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.554999:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.555054:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.555060:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.555069:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.555088:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:2.0:1790391367.555091:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391367.555096:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.555103:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960c00/0x35e94fc15449b616 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391367.560317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.561972:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108808064 00000100:00100000:0.0:1790391367.561987:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108808064 00000100:00100000:0.0:1790391367.562075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 223 00000100:00100000:0.0:1790391367.562087:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+63:11641:x1877361108808064:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391367.562113:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391367.562135:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20034 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.562214:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 64 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.562231:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 64 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.562254:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:0.0:1790391367.562258:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391367.562262:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978400, rc 0) 00000100:00100000:0.0:1790391367.562334:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+64:11641:x1877361108808064:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 250us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.562373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 223 00000100:00100000:0.0:1790391367.565978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391367.566223:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108808192 00000100:00100000:3.0:1790391367.566235:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108808192 00000100:00100000:3.0:1790391367.566376:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:3.0:1790391367.566389:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2364:x1877361108808192:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790391367.566990:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2364:x1877361108808192:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 602us (1023us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1790391367.567000:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00080000:1.0:1790391367.570730:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391367.575340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391367.575458:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108808448 00000100:00100000:3.0:1790391367.575471:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108808448 00000100:00100000:3.0:1790391367.575556:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:3.0:1790391367.575568:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+64:11641:x1877361108808448:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790391367.575997:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+65:11641:x1877361108808448:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 430us (668us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1790391367.576006:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 60 00000100:00100000:0.0:1790391367.584796:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.584903:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108808704 00000100:00100000:2.0:1790391367.584916:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108808704 00000100:00100000:2.0:1790391367.584980:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 224 00000100:00100000:2.0:1790391367.584991:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+65:11641:x1877361108808704:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790391367.585148:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+65:11641:x1877361108808704:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 159us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.585155:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 224 00000100:00100000:0.0:1790391367.591270:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.591363:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108808832 00000100:00100000:1.0:1790391367.591373:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108808832 00000100:00100000:1.0:1790391367.591434:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 225 00000100:00100000:1.0:1790391367.591444:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+65:11641:x1877361108808832:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391367.591465:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391367.591485:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2003b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.591550:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b62b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.591580:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.591661:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391367.591701:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391367.591718:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.591742:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960e00/0x35e94fc15449b624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2003b expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.591759:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b62b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2003b expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.591768:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:1.0:1790391367.591771:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790391367.591775:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e960200, rc 0) 00000100:00100000:1.0:1790391367.591844:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+66:11641:x1877361108808832:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 401us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.591852:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 225 00000100:00100000:2.0:1790391367.607156:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391367.609941:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108808960 00000100:00100000:3.0:1790391367.609959:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108808960 00000100:00100000:3.0:1790391367.610158:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:3.0:1790391367.610171:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+10:2364:x1877361108808960:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391367.610199:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391367.610220:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20042 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790391367.610247:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab73447, blocks: 0x1 00010000:00010000:3.0:1790391367.610268:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1790391367.610272:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391367.610282:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.610303:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.610317:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3200, rc 0) 00000100:00100000:3.0:1790391367.610401:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:2364:x1877361108808960:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 232us (3256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.610407:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:3.0:1790391367.619914:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.620118:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108809216 00000100:00100000:2.0:1790391367.620130:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108809216 00000100:00100000:2.0:1790391367.620205:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 226 00000100:00100000:2.0:1790391367.620216:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+66:11641:x1877361108809216:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790391367.620349:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+66:11641:x1877361108809216:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 135us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.620357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 226 00000100:00100000:1.0:1790391367.627263:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.627362:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108809344 00000100:00100000:2.0:1790391367.627373:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108809344 00000100:00100000:2.0:1790391367.627434:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:2.0:1790391367.627445:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+11:11641:x1877361108809344:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391367.627464:0:12080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391367.627483:0:12080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20049 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.627515:0:12080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 12 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.627524:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391367.627528:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391367.627534:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 12 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.627571:0:12080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 12 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.627585:0:12080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 12 pid: 6694 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.627616:0:12080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12080:1877361130811008:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391367.627738:0:12080:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391367.636476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.636936:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108809472 00000100:00100000:1.0:1790391367.636948:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108809472 00010000:00010000:1.0:1790391367.637005:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 13 pid: 6694 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.637117:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 81 00000100:00100000:1.0:1790391367.637128:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2364:x1877361108809472:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391367.637145:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391367.637171:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 13 pid: 6694 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.637197:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 13 pid: 6694 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.637226:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391367.637231:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391367.637241:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 13 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.637252:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 13 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.637291:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 13 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.637307:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b53b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1877361130811136:192.168.201.8@tcp:105: 00000100:00100000:1.0:1790391367.637387:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240681b480 going to sleep for 11 seconds 00010000:00010000:2.0:1790391367.637504:0:12080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002678ed01/0x35e94fc15449b632 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20042 expref: 13 pid: 6694 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.637521:0:12080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12080:1877361130811008:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391367.637544:0:12080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 12 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.637553:0:12080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10800, rc 0) 00000100:00100000:2.0:1790391367.637583:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:11641:x1877361108809344:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 10141us (10333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.637590:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:0.0:1790391367.648690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391367.648944:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108809600 00000100:00100000:3.0:1790391367.648954:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108809600 00002000:00100000:3.0:1790391367.649052:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96243a28d880 x1877361108809600/t0(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:233/0 lens 504/0 e 0 to 0 dl 1790391378 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790391367.649064:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96243a28d880 with x1877361108809600 ext(0->12) 00002000:00010000:3.0:1790391367.649070:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96243a28d880 00000100:00100000:3.0:1790391367.649096:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:3.0:1790391367.649107:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:2363:x1877361108809600:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790391367.649567:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+14:2363:x1877361108809600:12345-192.168.201.8@tcp:4:lhsmtool_posix.0 Request processed in 461us (886us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790391367.649576:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00002000:00100000:3.0:1790391367.649584:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96243a28d880 x1877361108809600/t4294967321(0) o4->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:233/0 lens 504/448 e 0 to 0 dl 1790391378 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790391367.649593:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96243a28d880 with x1877361108809600 ext(0->12) 00002000:00010000:3.0:1790391367.649596:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96243a28d880 00000100:00100000:1.0:1790391367.650495:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b53b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1877361130811136:192.168.201.8@tcp:105: 00010000:00010000:1.0:1790391367.650533:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391367.650581:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2364:x1877361108809472:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 13454us (14115us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.650592:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 81 00000100:00100000:0.0:1790391367.653421:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.653506:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108809728 00000100:00100000:2.0:1790391367.653516:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108809728 00000100:00100000:2.0:1790391367.653569:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 227 00000100:00100000:2.0:1790391367.653579:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+66:11641:x1877361108809728:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790391367.722611:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000001:00080000:3.0:1790391367.722648:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1790391367.722654:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1790391367.722678:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962406a79300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1790391367.722684:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962439ed0900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962406a79180 00000020:00080000:3.0:1790391367.722687:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962439ed0f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96243f901c00 00000004:00080000:3.0:1790391367.722716:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1790391367.722729:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96241be23e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1790391367.722731:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962435cc4e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96241be23780 00000020:00080000:3.0:1790391367.722747:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962435cc4a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962411ad4800 00000004:00080000:3.0:1790391367.722763:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1790391367.722789:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1790391367.722794:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1790391367.722815:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1790391367.723237:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130811264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790391367.723302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391367.723367:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391367.723372:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130811392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790391367.723390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391367.723417:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130811264 00000100:00100000:0.0:1790391367.723423:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130811264 00000100:00100000:0.0:1790391367.723471:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130811392 00000100:00100000:0.0:1790391367.723473:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130811392 00000100:00100000:0.0:1790391367.723488:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790391367.723495:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1877361130811264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790391367.723519:0:8917:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1790391367.723545:0:8917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.723567:0:8917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.723576:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1790391367.723589:0:8917:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391367.723594:0:8917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.723621:0:8917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.723634:0:8917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 12 pid: 6697 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.723645:0:8917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8917:1877361130811520:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391367.723695:0:8917:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e34840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391367.723709:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790391367.723716:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1877361130811392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790391367.723955:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790391367.723959:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790391367 00002000:00010000:0.0:1790391367.723961:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790391367.723964:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790391367 -> 1790391367 00002000:00010000:0.0:1790391367.723966:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790391367.724100:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1877361130811392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 383us (707us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1790391367.724107:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1790391367.724150:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962439b48a80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1790391367.724155:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130811392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790391367.724881:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:11641:x1877361108809728:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 Request processed in 71298us (71463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.724891:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 227 00000100:00080000:1.0:1790391367.726673:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391367.727930:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391367.727952:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130811648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790391367.728263:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391367.730483:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130811648 00000100:00100000:1.0:1790391367.730500:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130811648 00000100:00100000:1.0:1790391367.730612:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391367.730625:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3308:x1877361130811648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790391367.730661:0:12080:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1790391367.730697:0:12080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab73446, atime: 0x6ab73446, ctime: 0x6ab73446, blocks: 0x1 00010000:00010000:1.0:1790391367.730706:0:12080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.730723:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1790391367.730728:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391367.730735:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.730752:0:12080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.730764:0:12080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.730773:0:12080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.730825:0:12080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790391367.731455:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3308:x1877361130811648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 832us (3190us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790391367.731465:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:1.0:1790391367.731526:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962439f1aa00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790391367.731533:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130811648:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1790391367.733126:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:2.0:1790391367.733450:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790391367.735912:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391367.735927:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.735942:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391367.735947:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.735960:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.735996:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.736005:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de3eaae/0x35e94fc15449b647 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.736052:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391367.736054:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391367.736074:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391367.736466:0:8917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8917:1877361130811520:192.168.201.8@tcp:104: 00010000:00010000:1.0:1790391367.736491:0:8917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.746438:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.746527:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108809856 00000100:00100000:1.0:1790391367.746539:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108809856 00000100:00100000:0.0:1790391367.746552:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:1.0:1790391367.746592:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 13 pid: 6697 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.746632:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:1.0:1790391367.746643:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+13:2364:x1877361108809856:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391367.746660:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391367.746666:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 13 pid: 6697 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.746681:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 13 pid: 6697 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.746704:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b402 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ffa8 expref: 13 pid: 6697 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.746719:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391367.746724:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391367.746730:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.746752:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.746796:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391367.746855:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:2364:x1877361108809856:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 213us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.746862:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:3.0:1790391367.747988:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108809984 00000100:00100000:3.0:1790391367.748000:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108809984 00000100:00100000:3.0:1790391367.748088:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 70 00000100:00100000:3.0:1790391367.748097:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+12:2364:x1877361108809984:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1790391367.750099:0:8917:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.750118:0:8917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.750130:0:8917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.750137:0:8917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.750158:0:8917:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391367.755226:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391367.755242:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.755256:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391367.755261:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.755272:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.755294:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.755302:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000698e4dbf/0x35e94fc15449b640 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.755338:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391367.755340:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391367.755342:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391367.757742:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1877361130811264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34238us (34430us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1790391367.757755:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1790391367.757829:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962439b4a300/2, rc 0, transno 4294967323 00000100:00100000:0.0:1790391367.757835:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130811264:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1790391367.823881:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1790391367.823903:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1790391367.823910:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1790391367.824669:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108809984:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 Request processed in 76126us (77668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.824685:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 70 00000100:00100000:0.0:1790391367.831616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.831729:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108810240 00000100:00100000:2.0:1790391367.831741:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108810240 00000100:00100000:2.0:1790391367.831817:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 228 00000100:00100000:2.0:1790391367.831827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:11641:x1877361108810240:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391367.831883:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391367.831912:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960200/0x35e94fc15449b62b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2003b expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.831933:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:2.0:1790391367.831938:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391367.831968:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.831982:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.831992:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391367.834577:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa31adb4 reply state 00000000f93177ca transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.834595:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391367.834734:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:11641:x1877361108810240:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 2905us (3125us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790391367.834744:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 228 00000100:00100000:3.0:1790391367.838668:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:1.0:1790391367.838757:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.838771:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.838779:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.838786:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391367.838792:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.838801:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.838820:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:1.0:1790391367.838823:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391367.838844:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.838850:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11c00/0x35e94fc15449b64e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.839186:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108810368 00000100:00100000:2.0:1790391367.839196:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108810368 00000100:00100000:2.0:1790391367.839450:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 71 00000100:00100000:2.0:1790391367.839462:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2364:x1877361108810368:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790391367.839699:0:12080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790391367.839711:0:12080:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790391367 -> 1790391366 00002000:00010000:2.0:1790391367.839714:0:12080:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790391366 00002000:00010000:2.0:1790391367.839717:0:12080:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790391367 -> 1790391366 00002000:00010000:2.0:1790391367.839720:0:12080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790391367.839790:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2364:x1877361108810368:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 330us (1133us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1790391367.839798:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 71 00000100:00100000:3.0:1790391367.842761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.843112:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108810624 00000100:00100000:2.0:1790391367.843123:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108810624 00000100:00100000:2.0:1790391367.843241:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 229 00000100:00100000:2.0:1790391367.843253:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:11641:x1877361108810624:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790391367.843340:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.843358:0:11443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 20 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.843367:0:11443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.843403:0:11443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 20 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.843419:0:11443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 20 pid: 11443 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.843434:0:11443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130811776:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391367.843545:0:11443:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7f540 going to sleep for 11 seconds 00000100:00100000:2.0:1790391367.855602:0:11443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130811776:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391367.855638:0:11443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.863899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.864008:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108810752 00000100:00100000:1.0:1790391367.864058:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108810752 00010000:00010000:1.0:1790391367.864101:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 21 pid: 11443 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.864147:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 83 00000100:00100000:1.0:1790391367.864158:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:2363:x1877361108810752:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391367.864183:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391367.864190:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 21 pid: 11443 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.864203:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 21 pid: 11443 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.864227:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b60f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2002d expref: 21 pid: 11443 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.864245:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:1.0:1790391367.864250:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.864260:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.864286:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.864323:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391367.864378:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:2363:x1877361108810752:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 221us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.864386:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 83 00010000:00010000:3.0:1790391367.864464:0:11443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864472:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864504:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864512:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864518:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864524:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391367.864529:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864538:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864547:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:3.0:1790391367.864550:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790391367.864562:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391367.864568:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11e00/0x35e94fc15449b655 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391367.864625:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:11641:x1877361108810624:12345-192.168.201.8@tcp:55:lhsmtool_posix.0 Request processed in 21375us (21874us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790391367.864634:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 229 00000100:00100000:2.0:1790391367.878528:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.878882:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108810880 00000100:00100000:1.0:1790391367.878894:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108810880 00000100:00100000:1.0:1790391367.878963:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:1.0:1790391367.878974:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2363:x1877361108810880:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790391367.879142:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.879166:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 8 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.879187:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790391367.879192:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391367.879198:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.879315:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 8 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.879334:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 8 pid: 12080 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.879516:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b53100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130811904:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391367.879606:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff962403105300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391367.894910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.895195:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108811008 00000100:00100000:1.0:1790391367.895208:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108811008 00010000:00010000:1.0:1790391367.895259:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 9 pid: 12080 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391367.895309:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 84 00000100:00100000:1.0:1790391367.895320:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2363:x1877361108811008:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391367.895335:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391367.895361:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 9 pid: 12080 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.895376:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 9 pid: 12080 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.895405:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391367.895410:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391367.895416:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.895427:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391367.895450:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391367.895528:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+9:2363:x1877361108811008:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 208us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.895537:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 84 00010000:00010000:0.0:1790391367.899602:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9b5cfab/0x35e94fc15449b639 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20049 expref: 8 pid: 12080 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.899631:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b53100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1877361130811904:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391367.899662:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899697:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899705:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899741:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899751:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899760:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899767:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391367.899772:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899794:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899816:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.899835:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b65c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.899930:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2363:x1877361108810880:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 Request processed in 20956us (21413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.899940:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 72 00000100:00100000:2.0:1790391367.921216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.921322:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108811264 00000100:00100000:0.0:1790391367.921333:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108811264 00000100:00100000:0.0:1790391367.921395:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 230 00000100:00100000:0.0:1790391367.921407:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:11641:x1877361108811264:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790391367.921492:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.921510:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.921522:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.921754:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.921765:0:8292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.921773:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.921840:0:8292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.921855:0:8292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 20 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.921869:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130812032:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391367.921962:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e34f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391367.930943:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391367.931094:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108811392 00000100:00100000:2.0:1790391367.931104:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108811392 00010000:00010000:2.0:1790391367.931143:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 21 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.931197:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 85 00000100:00100000:2.0:1790391367.931209:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:2363:x1877361108811392:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391367.931225:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391367.931233:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 21 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.931246:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 21 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.931269:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:2.0:1790391367.931275:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.931286:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.931307:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.931331:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391367.931395:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:2363:x1877361108811392:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 188us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.931403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 85 00010000:00010000:0.0:1790391367.931569:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978400/0x35e94fc15449b61d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20034 expref: 20 pid: 5837 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391367.931586:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130812032:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391367.931608:0:8292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.931616:0:8292:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.931622:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391367.931800:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1790391367.931966:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790391367.932012:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1790391367.932294:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130812160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790391367.932344:0:8292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391367.932367:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407e34300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391367.932441:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130812160 00000100:00100000:2.0:1790391367.932447:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130812160 00000100:00100000:2.0:1790391367.932492:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391367.932500:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8292:x1877361130812160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790391367.932581:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8292:x1877361130812160:12345-0@lo:1000:mdt00_003.0 Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.932589:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391367.933005:0:8292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1790391367.933011:0:8292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1790391367.933052:0:8292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962439b48a80, transno 4294967322 00000100:00100000:3.0:1790391367.933069:0:8292:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff962439b4a300 x1877361130811264/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790391383 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391367.933080:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130812160:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790391367.933583:0:8292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790391367.934236:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130812288:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790391367.934294:0:8292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391367.934325:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391367.934397:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130812288 00000100:00100000:1.0:1790391367.934405:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130812288 00000100:00100000:1.0:1790391367.934455:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391367.934464:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8292:x1877361130812288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790391367.934652:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8292:x1877361130812288:12345-0@lo:1000:mdt00_003.0 Request processed in 188us (357us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1790391367.934659:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391367.934785:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8292:1877361130812288:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1790391367.934822:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934833:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934841:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934847:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.934865:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934874:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934892:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96240bf85500) 00010000:00010000:2.0:1790391367.934895:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391367.934900:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934908:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978200/0x35e94fc15449b66a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934941:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934947:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934953:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934958:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.934961:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934967:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.934974:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.934977:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391367.934990:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 23 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.935001:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 23 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.935010:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 23 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.935196:0:8292:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 23 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.935208:0:8292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130812416:192.168.201.8@tcp:105: 00000100:00100000:2.0:1790391367.935316:0:8292:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391367.944871:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391367.945054:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108811520 00000100:00100000:3.0:1790391367.945064:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108811520 00000100:00100000:3.0:1790391367.945125:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:3.0:1790391367.945136:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:11640:x1877361108811520:12345-192.168.201.8@tcp:49:lfs.0 00000100:00100000:3.0:1790391367.945675:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+24:11640:x1877361108811520:12345-192.168.201.8@tcp:49:lfs.0 Request processed in 538us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.945685:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 61 00000100:00100000:2.0:1790391367.953680:0:8292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8292:1877361130812416:192.168.201.8@tcp:105: 00010000:00010000:2.0:1790391367.953717:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953728:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3800/0x35e94fc15449b5ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953768:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953783:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953795:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953824:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953831:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953837:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953843:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.953847:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953853:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953866:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.953869:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391367.953873:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953879:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11000/0x35e94fc15449b671 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953889:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953895:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953901:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953912:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391367.953915:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953921:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953929:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391367.953931:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391367.953934:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.953939:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978800/0x35e94fc15449b663 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391367.954270:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:11641:x1877361108811264:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 32862us (33063us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1790391367.954279:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 230 00000020:00080000:2.0:1790391367.954286:0:8292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790391367.954460:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391367.954465:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391367.954945:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790391367.954956:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391367.957317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391367.957410:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391367.957501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108811776 00000100:00100000:0.0:1790391367.957512:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108811776 00000100:00100000:0.0:1790391367.957567:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 62 00000100:00100000:0.0:1790391367.957577:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+23:11641:x1877361108811776:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790391367.958169:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108812032 00000100:00100000:2.0:1790391367.958184:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108812032 00000100:00100000:2.0:1790391367.958215:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 231 00000100:00100000:2.0:1790391367.958222:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:11640:x1877361108812032:12345-192.168.201.8@tcp:58:lfs.0 00000040:00080000:2.0:1790391367.958482:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790391367.958571:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:11640:x1877361108812032:12345-192.168.201.8@tcp:58:lfs.0 Request processed in 348us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.958578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 231 00000004:00080000:0.0:1790391367.959472:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790391367.959582:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1790391367.959647:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.959665:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.959679:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.959688:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.959694:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.959700:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391367.959725:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790391367.959816:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:11641:x1877361108811776:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 2239us (2508us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1790391367.959825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 62 00000020:00080000:0.0:1790391367.959829:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790391367.959951:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391367.959966:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.959973:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391367.959978:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.959986:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.959999:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff962430751300) 00010000:00010000:2.0:1790391367.960002:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790391367.960007:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.960031:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978000/0x35e94fc15449b678 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391367.976118:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391367.976127:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391367.976130:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391368.020442:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391368.020566:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108812160 00000100:00100000:3.0:1790391368.020578:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108812160 00000100:00100000:3.0:1790391368.020823:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 232 00000100:00100000:3.0:1790391368.020838:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+25:11643:x1877361108812160:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391368.020886:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391368.020909:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b67f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20050 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021067:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021083:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021095:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021111:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021118:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021125:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021377:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021390:0:11443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021399:0:11443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021437:0:11443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391368.021459:0:11443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 26 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391368.021476:0:11443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f565f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130812544:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391368.021573:0:11443:0:(client.c:2716:ptlrpc_set_wait()) set ffff96240e94c840 going to sleep for 11 seconds 00010000:00010000:1.0:1790391368.025928:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391368.028281:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391368.035628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391368.036005:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108812416 00000100:00100000:1.0:1790391368.036054:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108812416 00000100:00100000:1.0:1790391368.036112:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:1.0:1790391368.036124:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:5602:x1877361108812416:12345-192.168.201.8@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790391368.036387:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:5602:x1877361108812416:12345-192.168.201.8@tcp:35:ldlm_bl.0 Request processed in 265us (768us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1790391368.036395:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 63 00000100:00100000:3.0:1790391368.036805:0:11443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f565f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11443:1877361130812544:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391368.036838:0:11443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391368.041645:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391368.041750:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108812544 00000100:00100000:2.0:1790391368.041761:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108812544 00010000:00010000:2.0:1790391368.041807:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 28 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391368.041859:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 86 00000100:00100000:2.0:1790391368.041871:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:2364:x1877361108812544:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391368.041887:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391368.041893:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 28 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391368.041920:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 28 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391368.041947:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10e00/0x35e94fc15449b59f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20011 expref: 28 pid: 5836 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391368.041966:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391368.041973:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391368.041983:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391368.041990:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391368.042181:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391368.042246:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+27:2364:x1877361108812544:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 376us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391368.042255:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 86 00010000:00010000:0.0:1790391368.042444:0:11443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042461:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391368.042510:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790391368.042515:0:11443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391368.042540:0:11443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042556:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042567:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042575:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042581:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042588:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391368.042592:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042600:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042609:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391368.042612:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391368.042616:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042632:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449b686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042645:0:11443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042651:0:11443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042657:0:11443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042661:0:11443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391368.042664:0:11443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042670:0:11443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042678:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff962411373900) 00010000:00010000:0.0:1790391368.042681:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391368.042684:0:11443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042689:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3600/0x35e94fc15449b68d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042725:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b67f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20050 expref: 27 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042750:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20050 expref: 26 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391368.042758:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391368.042760:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391368.042763:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3e00, rc 0) 00000100:00100000:0.0:1790391368.042805:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11643:x1877361108812160:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 21972us (22374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391368.042812:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 232 00000100:00100000:0.0:1790391368.601764:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130813056:0@lo:400:kworker.0 00000100:00100000:0.0:1790391368.601865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391368.601948:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391368.601955:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130812672:0@lo:400:kworker.0 00000100:00100000:0.0:1790391368.601990:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391368.602047:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130812800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391368.602074:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391368.602091:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391368.602096:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130812928:0@lo:400:kworker.0 00000100:00100000:0.0:1790391368.602116:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391368.602152:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130813056 00000100:00100000:0.0:1790391368.602174:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130813056 00000100:00100000:0.0:1790391368.602249:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130812800 00000100:00100000:0.0:1790391368.602253:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130812800 00000100:00100000:0.0:1790391368.602273:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130812928 00000100:00100000:0.0:1790391368.602275:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130812928 00000100:00100000:0.0:1790391368.602294:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790391368.602752:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130813056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391368.602830:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130813056:12345-0@lo:400:kworker.0 Request processed in 82us (965us total) trans 0 rc 0/0 00000100:00080000:3.0:1790391368.612720:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391368.614821:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130813184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391368.614911:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391368.614974:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130813184 00000100:00100000:3.0:1790391368.614985:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130813184 00000100:00100000:3.0:1790391368.615081:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391368.615092:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1877361130813184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391368.615124:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391368.615191:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1877361130813184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.615204:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391368.615270:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130813184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391368.615280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790391368.615310:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130812800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391368.615330:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790391368.615339:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130812928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391368.615362:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130812800:12345-0@lo:400:kworker.0 Request processed in 72us (13286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.615368:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130812928:12345-0@lo:400:kworker.0 Request processed in 31us (13251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391368.615369:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790391368.615385:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790391368.615413:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130812672 00000100:00100000:3.0:1790391368.615417:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130812672 00000100:00100000:3.0:1790391368.615444:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1790391368.615451:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130812672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391368.615485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130812672:12345-0@lo:400:kworker.0 Request processed in 35us (13495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.615491:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790391368.615576:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130812928:0@lo:400:kworker.0 00000100:00100000:1.0:1790391368.615594:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130812800:0@lo:400:kworker.0 00000100:00100000:1.0:1790391368.615761:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962411ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130812672:0@lo:400:kworker.0 00000100:00100000:1.0:1790391368.615776:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130813056:0@lo:400:kworker.0 00000100:00100000:0.0:1790391368.627199:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790391368.974340:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391368.974406:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391368.974456:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391368.974480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391368.974514:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391368.974555:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108813056 00000100:00100000:1.0:1790391368.974568:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108813056 00000100:00100000:1.0:1790391368.974646:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108812928 00000100:00100000:1.0:1790391368.974650:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108812928 00000100:00100000:1.0:1790391368.974678:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:1.0:1790391368.974691:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108813056:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391368.974785:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108813056:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 97us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391368.974792:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:1.0:1790391368.974811:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 79 00000100:00100000:1.0:1790391368.974835:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108812928:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391368.974860:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108812928:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391368.974865:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 79 00000100:00100000:1.0:1790391368.974884:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108812672 00000100:00100000:1.0:1790391368.974887:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108812672 00000100:00100000:1.0:1790391368.974910:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 297 00000100:00100000:1.0:1790391368.974916:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108812672:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391368.974938:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108812672:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 22us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391368.974943:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 297 00000100:00100000:3.0:1790391368.975095:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108812800 00000100:00100000:3.0:1790391368.975100:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108812800 00000100:00100000:3.0:1790391368.975133:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108813184 00000100:00100000:3.0:1790391368.975136:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108813184 00000100:00100000:3.0:1790391368.975183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 161 00000100:00100000:3.0:1790391368.975191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:2365:x1877361108812800:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.975228:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:2365:x1877361108812800:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 39us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.975235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 161 00000100:00100000:3.0:1790391368.975250:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 162 00000100:00100000:3.0:1790391368.975256:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108813184:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.975281:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2365:x1877361108813184:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.975287:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 162 00000100:00080000:3.0:1790391368.975308:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391368.975315:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1790391368.991934:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391368.991949:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391368.992006:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790391368.992083:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391368.992263:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130813312:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391368.992394:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391369.003422:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439f6a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1877361130813312:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391369.007318:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391369.007379:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108813312 00000100:00100000:2.0:1790391369.007394:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108813312 00000100:00100000:2.0:1790391369.007480:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 233 00000100:00100000:2.0:1790391369.007494:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11654:x1877361108813312:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790391369.007542:0:8292:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790391369.007691:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11654:x1877361108813312:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 199us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391369.007720:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 233 00000100:00100000:3.0:1790391369.013331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391369.013944:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108813568 00000100:00100000:2.0:1790391369.013960:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108813568 00000100:00100000:2.0:1790391369.014061:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 234 00000100:00100000:2.0:1790391369.014073:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+26:11654:x1877361108813568:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391369.014101:0:11443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391369.014134:0:11443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b69b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20057 expref: -99 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.014290:0:11443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b6a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.014311:0:11443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.014328:0:11443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391369.014342:0:11443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790391369.014501:0:11443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10800/0x35e94fc15449b69b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20057 expref: 29 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.014521:0:11443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20057 expref: 28 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.014531:0:11443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391369.014534:0:11443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391369.014539:0:11443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11600, rc 0) 00000100:00100000:2.0:1790391369.014630:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:11654:x1877361108813568:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 560us (1317us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790391369.014639:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 234 00000100:00100000:1.0:1790391369.019344:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391369.019889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108813824 00000100:00100000:3.0:1790391369.019904:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108813824 00000100:00100000:3.0:1790391369.019998:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 235 00000100:00100000:3.0:1790391369.020031:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:11654:x1877361108813824:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790391369.020145:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020180:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020196:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020475:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020485:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020493:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020500:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391369.020505:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020514:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020543:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391369.020547:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391369.020554:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.020562:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391369.020924:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:11654:x1877361108813824:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 911us (1589us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1790391369.020934:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 235 00000040:00080000:1.0:1790391369.021361:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391369.021369:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391369.023132:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790391369.023241:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391369.037351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391369.045237:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108813952 00000100:00100000:0.0:1790391369.045263:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108813952 00000100:00100000:0.0:1790391369.045392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:0.0:1790391369.045408:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240312d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:2366:x1877361108813952:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391369.045430:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391369.045466:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11600/0x35e94fc15449b6a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20057 expref: 29 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391369.045494:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391369.045502:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391369.045597:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240312d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:2366:x1877361108813952:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 193us (8261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391369.045607:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:2.0:1790391369.046575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391369.047591:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108814208 00000100:00100000:0.0:1790391369.047607:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108814208 00000100:00100000:0.0:1790391369.047688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 64 00000100:00100000:0.0:1790391369.047700:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+28:11654:x1877361108814208:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790391369.048264:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:11654:x1877361108814208:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 565us (1695us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1790391369.048273:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 64 00010000:00010000:2.0:1790391369.058456:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391369.167946:0:12575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391369.168436:0:12575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391369.168516:0:12575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790391369.168524:0:12575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790391369.390974:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391369.393687:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108814464 00000100:00100000:2.0:1790391369.393705:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108814464 00000100:00100000:2.0:1790391369.393940:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 236 00000100:00100000:2.0:1790391369.393962:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+29:11667:x1877361108814464:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391369.394003:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391369.394055:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2005e expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.394196:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b6be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.394214:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b6be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.394228:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b6be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391369.394242:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790391369.394431:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2005e expref: 32 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.394464:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b6be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2005e expref: 31 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391369.394475:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:2.0:1790391369.394478:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790391369.394484:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10600, rc 0) 00000100:00100000:2.0:1790391369.394591:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:11667:x1877361108814464:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 632us (3634us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1790391369.394600:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 236 00000100:00100000:1.0:1790391369.404519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391369.404687:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108814592 00000100:00100000:3.0:1790391369.404703:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108814592 00000100:00100000:3.0:1790391369.404802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 237 00000100:00100000:3.0:1790391369.404814:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:11667:x1877361108814592:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:3.0:1790391369.404900:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.404919:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.404931:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.404959:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.404966:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.404991:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.404996:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391369.405002:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.405010:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.405076:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:3.0:1790391369.405079:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391369.405084:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391369.405090:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2e00/0x35e94fc15449b6cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391369.405195:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+31:11667:x1877361108814592:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 383us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391369.405204:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 237 00000100:00100000:0.0:1790391369.547354:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391369.547452:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108814720 00000100:00100000:1.0:1790391369.547472:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108814720 00000100:00100000:1.0:1790391369.547623:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00100000:1.0:1790391369.547637:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2366:x1877361108814720:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:1.0:1790391369.547674:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391369.547702:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b6d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20065 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391369.547738:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6ab73446, atime: 0x6ab73446, ctime: 0x6ab73446, blocks: 0xb 00010000:00010000:1.0:1790391369.547778:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1790391369.547784:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391369.547797:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b6d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20065 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391369.547821:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b6d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20065 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391369.547841:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e961000, rc 0) 00000100:00100000:1.0:1790391369.547942:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2366:x1877361108814720:12345-192.168.201.8@tcp:101:cat.0 Request processed in 308us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391369.547957:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 73 00000100:00080000:3.0:1790391369.551353:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391369.554193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391369.555484:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108814848 00000100:00100000:2.0:1790391369.555499:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108814848 00002000:00100000:2.0:1790391369.555566:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff962411a18000 x1877361108814848/t0(0) o3->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:235/0 lens 488/0 e 0 to 0 dl 1790391380 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391369.555576:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962411a18000 with x1877361108814848 ext(0->4095) 00002000:00010000:2.0:1790391369.555582:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962411a18000 00000100:00100000:2.0:1790391369.555621:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:2.0:1790391369.555631:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2365:x1877361108814848:12345-192.168.201.8@tcp:3:cat.0 00000100:00100000:2.0:1790391369.555907:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+8:2365:x1877361108814848:12345-192.168.201.8@tcp:3:cat.0 Request processed in 276us (1997us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790391369.555912:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00002000:00100000:2.0:1790391369.555919:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff962411a18000 x1877361108814848/t0(0) o3->df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f@192.168.201.8@tcp:235/0 lens 488/4536 e 0 to 0 dl 1790391380 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391369.555927:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff962411a18000 with x1877361108814848 ext(0->4095) 00002000:00010000:2.0:1790391369.555931:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff962411a18000 00010000:00010000:1.0:1790391370.076547:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790391370.230507:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1790391370.230528:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1790391370.650230:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391370.650263:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130813440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391370.650361:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391370.650449:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130813440 00000100:00100000:3.0:1790391370.650459:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130813440 00000100:00100000:3.0:1790391370.650535:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391370.650546:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130813440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391370.650613:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391370.650668:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130813440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391370.650677:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1790391370.650703:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391370.650763:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130813440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790391371.102198:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391372.121719:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391372.121734:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391372.121776:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790391372.121785:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790391372.122469:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790391372.821869:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1790391372.823065:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1790391372.823109:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96240e94cf00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1790391372.823116:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96243f646400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96240e94c300 00000020:00080000:3.0:1790391372.823120:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96243f646300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962411ad6000 00000020:00080000:3.0:1790391372.823137:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1790391372.823157:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790391372.825290:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1790391373.146627:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790391373.325234:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1790391373.325266:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1790391373.325275:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:1.0:1790391373.722302:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391373.722340:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130813568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391373.722468:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391373.723225:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130813568 00000100:00100000:3.0:1790391373.723239:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130813568 00000100:00100000:3.0:1790391373.723341:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391373.723356:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130813568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391373.723406:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391373.723697:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130813568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391373.723705:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391373.723988:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130813824:0@lo:400:kworker.0 00000100:00100000:1.0:1790391373.724181:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130813952:0@lo:400:kworker.0 00000100:00080000:2.0:1790391373.724352:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391373.724726:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130813696:0@lo:400:kworker.0 00000100:00100000:2.0:1790391373.733236:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130814080:0@lo:400:kworker.0 00000100:00100000:1.0:1790391373.735833:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391373.735964:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1790391373.735973:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96243f721c00, transno 4294967307 00000004:00080000:1.0:1790391373.735992:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1790391373.736041:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962439f1aa00, transno 4294967310 00000100:00100000:1.0:1790391373.736064:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130813568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391373.736135:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130813952 00000100:00100000:1.0:1790391373.736144:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130813952 00000100:00100000:1.0:1790391373.736224:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790391373.736235:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130813952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391373.736305:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130813952:12345-0@lo:400:kworker.0 Request processed in 71us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391373.736312:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1790391373.736341:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391373.736361:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1790391373.736366:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962439b4a300, transno 4294967323 00000004:00080000:1.0:1790391373.736377:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1790391373.736394:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130813952:0@lo:400:kworker.0 00000100:00100000:0.0:1790391373.736611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391373.736653:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130814208:0@lo:400:kworker.0 00000100:00100000:0.0:1790391373.736689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391373.736731:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130813696 00000100:00100000:0.0:1790391373.736735:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130813696 00000100:00100000:0.0:1790391373.736766:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790391373.736772:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130813696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391373.736808:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130813696:12345-0@lo:400:kworker.0 Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391373.736814:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790391373.736844:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814208 00000100:00100000:0.0:1790391373.736848:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814208 00000100:00100000:1.0:1790391373.736875:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130813696:0@lo:400:kworker.0 00000100:00100000:0.0:1790391373.736882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790391373.736888:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130814208:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790391373.736895:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391373.736923:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96241f2a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130814208:12345-0@lo:400:kworker.0 Request processed in 35us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391373.736930:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790391373.736953:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130814208:0@lo:400:kworker.0 00000100:00100000:3.0:1790391373.742247:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391373.742573:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130813824 00000100:00100000:0.0:1790391373.742587:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130813824 00000100:00100000:0.0:1790391373.742659:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790391373.742672:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130813824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391373.742784:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130813824:12345-0@lo:400:kworker.0 Request processed in 113us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391373.742814:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790391373.749650:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130813824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391373.750229:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391373.750415:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814080 00000100:00100000:3.0:1790391373.750424:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814080 00000100:00100000:3.0:1790391373.750595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790391373.750608:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130814080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391373.750687:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130814080:12345-0@lo:400:kworker.0 Request processed in 82us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391373.750695:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790391373.755933:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130814080:0@lo:400:kworker.0 00000100:00080000:1.0:1790391373.756160:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391374.094947:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391374.095009:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391374.095151:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391374.095153:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108814976 00000100:00100000:3.0:1790391374.095168:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108814976 00000100:00100000:2.0:1790391374.095214:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108815488 00000100:00100000:2.0:1790391374.095221:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108815488 00000100:00100000:3.0:1790391374.095255:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 299 00000100:00100000:3.0:1790391374.095269:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108814976:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391374.095272:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108815232 00000100:00100000:2.0:1790391374.095277:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 166 00000100:00100000:1.0:1790391374.095279:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108815232 00000100:00100000:2.0:1790391374.095287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108815488:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391374.095318:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 81 00000100:00100000:3.0:1790391374.095374:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108814976:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 107us (443us total) trans 0 rc 0/0 00000100:00080000:0.0:1790391374.095380:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391374.095386:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 299 00000100:00080000:0.0:1790391374.095389:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391374.095443:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2366:x1877361108815232:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391374.099365:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2366:x1877361108815488:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 4060us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391374.099389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 166 00000100:00100000:1.0:1790391374.103280:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2366:x1877361108815232:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 7821us (8251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391374.103300:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 81 00000100:00100000:0.0:1790391374.105740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391374.105822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391374.106002:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108815104 00000100:00100000:1.0:1790391374.106045:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108815104 00000100:00100000:1.0:1790391374.106151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00100000:1.0:1790391374.106164:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:2366:x1877361108815104:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391374.106268:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:2366:x1877361108815104:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 106us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391374.106277:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 167 00000100:00080000:0.0:1790391374.107060:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391374.107349:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108815360 00000100:00100000:3.0:1790391374.107362:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108815360 00000100:00100000:3.0:1790391374.107513:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:3.0:1790391374.107527:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108815360:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391374.107595:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2366:x1877361108815360:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 74us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391374.107604:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00080000:0.0:1790391374.107675:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790391374.169749:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391375.196174:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391375.258086:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391375.258222:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108815616 00000100:00100000:1.0:1790391375.258237:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108815616 00000100:00100000:1.0:1790391375.258328:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 238 00000100:00100000:1.0:1790391375.258342:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11329:x1877361108815616:12345-192.168.201.8@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790391375.258475:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11329:x1877361108815616:12345-192.168.201.8@tcp:60:lhsmtool_posix.0 Request processed in 136us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391375.258483:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 238 00000100:00100000:2.0:1790391375.269428:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391375.270463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108815872 00000100:00100000:0.0:1790391375.270482:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108815872 00000100:00100000:0.0:1790391375.270572:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:0.0:1790391375.270585:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:11329:x1877361108815872:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790391375.271476:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:11329:x1877361108815872:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 889us (2059us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790391375.271487:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 65 00000100:00100000:0.0:1790391375.494271:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391375.494436:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108816000 00000100:00100000:2.0:1790391375.494450:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108816000 00000100:00100000:2.0:1790391375.494529:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 239 00000100:00100000:2.0:1790391375.494542:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:12119:x1877361108816000:12345-192.168.201.8@tcp:101:lsof.0 00010000:00010000:2.0:1790391375.494571:0:8292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391375.494603:0:8292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b6da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2006c expref: -99 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391375.494900:0:8292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391375.494937:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391375.494952:0:8292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391375.495001:0:8292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790391375.495005:0:8292:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391375.495246:0:8292:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391375.495281:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11a00/0x35e94fc15449b6da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2006c expref: 7 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391375.495303:0:8292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2006c expref: 6 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391375.495315:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:2.0:1790391375.495319:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391375.495322:0:8292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10400, rc 0) 00000100:00100000:2.0:1790391375.495624:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:12119:x1877361108816000:12345-192.168.201.8@tcp:101:lsof.0 Request processed in 1074us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391375.495635:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 239 00000100:00100000:2.0:1790391375.772061:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391375.772102:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130814336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391375.772183:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391375.772710:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814336 00000100:00100000:1.0:1790391375.772722:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814336 00000100:00100000:1.0:1790391375.772812:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790391375.772833:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130814336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391375.772878:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391375.773085:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130814336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391375.773166:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790391375.773462:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391375.773793:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130814336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391376.217632:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391377.241875:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790391377.864075:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1790391377.864108:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1790391377.864178:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790391377.864195:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1790391378.271136:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391378.841668:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130814720:0@lo:400:kworker.0 00000100:00100000:0.0:1790391378.841670:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130814464:0@lo:400:kworker.0 00000100:00100000:2.0:1790391378.844132:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130814592:0@lo:400:kworker.0 00000100:00100000:1.0:1790391378.844935:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130814848:0@lo:400:kworker.0 00000100:00100000:0.0:1790391378.847380:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391378.847439:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814464 00000100:00100000:0.0:1790391378.847448:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814464 00000100:00100000:0.0:1790391378.848339:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790391378.848356:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130814464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391378.848425:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130814464:12345-0@lo:400:kworker.0 Request processed in 75us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391378.848433:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790391378.848605:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130814464:0@lo:400:kworker.0 00000100:00100000:0.0:1790391378.848618:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130814976:0@lo:400:kworker.0 00000100:00100000:0.0:1790391378.848657:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391378.851235:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814976 00000100:00100000:3.0:1790391378.851267:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814976 00000100:00100000:3.0:1790391378.851353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790391378.851367:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130814976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391378.851456:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130814976:12345-0@lo:400:kworker.0 Request processed in 95us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391378.851464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790391378.851558:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130814976:0@lo:400:kworker.0 00000100:00100000:3.0:1790391378.851599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391378.851628:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814720 00000100:00100000:3.0:1790391378.851632:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814720 00000100:00100000:3.0:1790391378.851662:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790391378.851670:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130814720:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790391378.851679:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391378.851685:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391378.851702:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130814720:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391378.851707:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790391378.851736:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130814720:0@lo:400:kworker.0 00000100:00100000:3.0:1790391378.851754:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130815232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391378.851787:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391378.851812:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130815232 00000100:00100000:3.0:1790391378.851815:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130815232 00000100:00100000:3.0:1790391378.851843:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790391378.851849:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130815232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391378.851876:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391378.851908:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130815232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391378.851914:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790391378.851953:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391378.852120:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130815232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391378.854619:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391378.854670:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130815104:0@lo:400:kworker.0 00000100:00100000:2.0:1790391378.854699:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391378.854752:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130815104 00000100:00100000:2.0:1790391378.854760:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130815104 00000100:00100000:2.0:1790391378.854803:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790391378.854811:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130815104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391378.854856:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130815104:12345-0@lo:400:kworker.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391378.854862:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790391378.854919:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130815104:0@lo:400:kworker.0 00000100:00100000:3.0:1790391378.855106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814592 00000100:00100000:3.0:1790391378.855111:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814592 00000100:00100000:3.0:1790391378.855141:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790391378.855148:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130814592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391378.855184:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130814592:12345-0@lo:400:kworker.0 Request processed in 37us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391378.855190:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790391378.855390:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130814592:0@lo:400:kworker.0 00000100:00100000:1.0:1790391378.857488:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391378.857691:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130814848 00000100:00100000:2.0:1790391378.857701:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130814848 00000100:00100000:2.0:1790391378.857775:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790391378.857784:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130814848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391378.857840:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130814848:12345-0@lo:400:kworker.0 Request processed in 58us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391378.857847:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790391378.857882:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130814848:0@lo:400:kworker.0 00000100:00080000:3.0:1790391378.858011:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391379.212754:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391379.212802:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391379.212833:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391379.212855:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391379.212890:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391379.215382:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108816128 00000100:00100000:3.0:1790391379.215408:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108816128 00000100:00100000:3.0:1790391379.215511:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 301 00000100:00100000:3.0:1790391379.215524:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108816128:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391379.215628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2365:x1877361108816128:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 107us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391379.215636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 301 00000100:00100000:3.0:1790391379.215684:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108816384 00000100:00100000:3.0:1790391379.215689:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108816384 00000100:00100000:3.0:1790391379.215729:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108816512 00000100:00100000:3.0:1790391379.215732:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108816512 00000100:00100000:3.0:1790391379.215768:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 85 00000100:00100000:3.0:1790391379.215775:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108816384:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391379.215811:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2365:x1877361108816384:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 38us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391379.215817:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 85 00000100:00100000:3.0:1790391379.215831:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 86 00000100:00100000:3.0:1790391379.215854:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108816512:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391379.215962:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2365:x1877361108816512:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 108us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391379.215969:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 86 00000100:00100000:3.0:1790391379.216004:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108816640 00000100:00100000:3.0:1790391379.216008:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108816640 00000100:00100000:3.0:1790391379.217209:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108816256 00000100:00100000:3.0:1790391379.217222:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108816256 00000100:00100000:3.0:1790391379.217282:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:3.0:1790391379.217293:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2365:x1877361108816640:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391379.217374:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2365:x1877361108816640:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 83us (4539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391379.217381:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 171 00000100:00100000:3.0:1790391379.217399:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00100000:3.0:1790391379.217407:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:2365:x1877361108816256:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391379.217441:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:2365:x1877361108816256:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 35us (4585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391379.217447:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 172 00000100:00080000:3.0:1790391379.217676:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391379.217684:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391379.217688:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1790391379.299955:0:12779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:56:17 (1790391377) 00010000:00010000:2.0:1790391379.309004:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391380.318127:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391380.890136:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391380.890159:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130815360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391380.890225:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391380.890303:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130815360 00000100:00100000:2.0:1790391380.890312:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130815360 00000100:00100000:2.0:1790391380.890368:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391380.890377:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130815360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391380.890411:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391380.890455:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130815360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391380.890464:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1790391380.890484:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391380.890527:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130815360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790391381.337808:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391382.362450:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790391382.362463:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790391382.364461:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1790391382.364478:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790391382.372760:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391383.385369:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391383.724512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391383.724642:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108816896 00000100:00100000:2.0:1790391383.724656:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108816896 00000100:00100000:2.0:1790391383.724754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00100000:2.0:1790391383.724768:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+18:12340:x1877361108816896:12345-192.168.201.8@tcp:35:umount.0 00000100:00100000:2.0:1790391383.725323:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:12340:x1877361108816896:12345-192.168.201.8@tcp:35:umount.0 Request processed in 557us (857us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1790391383.725331:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 66 00000100:00080000:3.0:1790391383.725425:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391383.730561:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391383.730700:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108817152 00000100:00100000:2.0:1790391383.730715:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108817152 00000100:00100000:2.0:1790391383.730855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:2.0:1790391383.730870:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+19:12340:x1877361108817152:12345-192.168.201.8@tcp:35:umount.0 00000100:00100000:2.0:1790391383.737654:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:12340:x1877361108817152:12345-192.168.201.8@tcp:35:umount.0 Request processed in 6766us (7090us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1790391383.737675:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 67 00000100:00100000:1.0:1790391383.744860:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391383.745104:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108817408 00000100:00100000:0.0:1790391383.745120:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108817408 00000100:00100000:0.0:1790391383.745200:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:0.0:1790391383.745214:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962407b65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+20:12340:x1877361108817408:12345-192.168.201.8@tcp:35:umount.0 00000100:00100000:0.0:1790391383.745576:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962407b65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:12340:x1877361108817408:12345-192.168.201.8@tcp:35:umount.0 Request processed in 364us (731us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1790391383.745584:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 68 00000100:00100000:1.0:1790391383.749495:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391383.749723:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108817664 00000100:00100000:0.0:1790391383.749738:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108817664 00000100:00100000:0.0:1790391383.749813:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 69 00000100:00100000:0.0:1790391383.749827:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:12340:x1877361108817664:12345-192.168.201.8@tcp:35:umount.0 00000100:00100000:1.0:1790391383.750740:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:12340:x1877361108817664:12345-192.168.201.8@tcp:35:umount.0 Request processed in 910us (1254us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1790391383.750751:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 69 00000100:00100000:3.0:1790391383.756746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391383.756794:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391383.756827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391383.756872:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391383.756934:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108818176 00000100:00100000:3.0:1790391383.756947:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108818176 00000100:00100000:3.0:1790391383.757070:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 74 00000100:00100000:3.0:1790391383.757084:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2362:x1877361108818176:12345-192.168.201.8@tcp:9:umount.0 00000020:00000080:3.0:1790391383.757125:0:12080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449aa31 00000100:00080000:3.0:1790391383.757136:0:12080:0:(import.c:65:import_set_state_nolock()) ffff962411a36800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391383.757185:0:12080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1790391383.757552:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+2:2362:x1877361108818176:12345-192.168.201.8@tcp:9:umount.0 Request processed in 469us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391383.757565:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 74 00000100:00080000:3.0:1790391383.757598:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391383.757941:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108817792 00000100:00100000:2.0:1790391383.757949:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108817792 00000100:00100000:2.0:1790391383.757991:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108818048 00000100:00100000:2.0:1790391383.757995:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108818048 00000100:00100000:2.0:1790391383.758007:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108817920 00000100:00100000:2.0:1790391383.758010:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108817920 00000100:00100000:2.0:1790391383.758068:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:2.0:1790391383.758077:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+15:2366:x1877361108817792:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391383.758092:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391383.758116:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2400/0x35e94fc15449a759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbf7 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391383.758137:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391383.758167:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+14:2366:x1877361108817792:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 92us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.758175:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:2.0:1790391383.758190:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:2.0:1790391383.758196:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+13:2366:x1877361108818048:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391383.758205:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391383.758214:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2c00/0x35e94fc15449a96d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcc2 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391383.758224:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391383.758239:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+12:2366:x1877361108818048:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 44us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.758246:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:2.0:1790391383.758257:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:2.0:1790391383.758263:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+11:2366:x1877361108817920:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391383.758289:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391383.758299:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8fa00/0x35e94fc15449a6bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbbf expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391383.758308:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391383.758325:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108817920:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 61us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.758331:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00010000:00010000:0.0:1790391383.759062:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391383.767841:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391383.767957:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108818560 00000100:00100000:0.0:1790391383.767971:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108818560 00000100:00100000:0.0:1790391383.768113:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 75 00000100:00100000:0.0:1790391383.768126:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9624399bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+7:2362:x1877361108818560:12345-192.168.201.8@tcp:9:umount.0 00000020:00000080:0.0:1790391383.768168:0:8917:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449ac99 00000020:00010000:0.0:1790391383.768178:0:8917:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962403a85000: total 0 00000100:00080000:0.0:1790391383.768184:0:8917:0:(import.c:65:import_set_state_nolock()) ffff962403a85800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790391383.768236:0:8917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1790391383.768617:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9624399bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+5:2362:x1877361108818560:12345-192.168.201.8@tcp:9:umount.0 Request processed in 491us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391383.768626:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 75 00000020:00010000:0.0:1790391383.768655:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962403a85000: total 0 00010000:00010000:0.0:1790391383.768677:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962403a85000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1790391383.768749:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b6d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20065 expref: 4 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.768791:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c708dc7f/0x35e94fc15449b035 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe97 expref: 3 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.768809:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962403a85000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1790391383.768820:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391383.768823:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391383.768825:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391383.769562:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391383.775416:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391383.775532:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108819584 00000100:00100000:1.0:1790391383.775546:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108819584 00000100:00100000:1.0:1790391383.775629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 240 00000100:00100000:1.0:1790391383.775643:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+22:2362:x1877361108819584:12345-192.168.201.8@tcp:39:umount.0 00000020:00000080:1.0:1790391383.775692:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a6cd 00000020:00010000:1.0:1790391383.775715:0:5836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96240e8da800: total 0 00000100:00080000:1.0:1790391383.775721:0:5836:0:(import.c:65:import_set_state_nolock()) ffff96240e8da000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391383.775757:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1790391383.776284:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f+21:2362:x1877361108819584:12345-192.168.201.8@tcp:39:umount.0 Request processed in 640us (881us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1790391383.776293:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 240 00000020:00010000:0.0:1790391383.776996:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96240e8da800: total 0 00010000:00010000:0.0:1790391383.777004:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391383.777101:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96240e8da800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1790391383.777159:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391383.777164:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391383.777177:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449b694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20050 expref: 20 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777202:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:0.0:1790391383.777205:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391383.777210:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449b097 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feb3 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777227:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391383.777229:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391383.777234:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30c00/0x35e94fc15449aff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe82 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777247:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391383.777250:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790391383.777254:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2200/0x35e94fc15449b020 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe90 expref: 17 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777268:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391383.777271:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391383.777275:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e960800/0x35e94fc15449b392 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1ff8c expref: 16 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777288:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391383.777290:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790391383.777294:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10600/0x35e94fc15449b6be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2005e expref: 15 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777323:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391383.777326:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391383.777331:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30400/0x35e94fc15449acf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fdbe expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777344:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9624119e7600) 00010000:00010000:0.0:1790391383.777347:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391383.777351:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449a997 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcd0 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777371:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff962430751a00) 00010000:00010000:0.0:1790391383.777374:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790391383.777378:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e978a00/0x35e94fc15449b0b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1feba expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777397:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff962430751100) 00010000:00010000:0.0:1790391383.777400:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391383.777403:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10000/0x35e94fc15449af16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fe4a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777418:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff962411373f00) 00010000:00010000:0.0:1790391383.777421:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790391383.777424:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3c00/0x35e94fc15449aa07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcec expref: 10 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777439:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff962411373600) 00010000:00010000:0.0:1790391383.777442:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391383.777452:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979000/0x35e94fc15449b5b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20018 expref: 9 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777471:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96240bf85000) 00010000:00010000:0.0:1790391383.777473:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391383.777477:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f11400/0x35e94fc15449a9b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcd7 expref: 8 pid: 11443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391383.777492:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96240e8da800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1790391383.777506:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391383.777508:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391383.777511:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391383.961417:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130815744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391383.961519:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391383.961588:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391383.961595:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130815872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391383.961625:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391383.961749:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130815616:0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.961778:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391383.961803:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130816128:0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.961818:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391383.961833:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790391383.961836:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130815488:0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.961859:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391383.961873:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130816000:0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.961897:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391383.961945:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130815744 00000100:00100000:0.0:1790391383.961954:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130815744 00000100:00100000:0.0:1790391383.962033:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816128 00000100:00100000:0.0:1790391383.962037:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816128 00000100:00100000:0.0:1790391383.962068:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391383.962080:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130815744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.962146:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130815744:12345-0@lo:400:kworker.0 Request processed in 67us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391383.962169:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391383.962186:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790391383.962190:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130816128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.962216:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130816128:12345-0@lo:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391383.962220:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790391383.962234:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130815488 00000100:00100000:0.0:1790391383.962236:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130815488 00000100:00100000:0.0:1790391383.962254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790391383.962258:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130815488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.962276:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c86877e-0672-4feb-acd6-39a38006ba27+19:3310:x1877361130815488:12345-0@lo:400:kworker.0 Request processed in 18us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391383.962280:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1790391383.962316:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130815488:0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.962327:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130816128:0@lo:400:kworker.0 00000100:00100000:0.0:1790391383.962360:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130815744:0@lo:400:kworker.0 00000100:00100000:1.0:1790391383.962559:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391383.962568:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130816256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391383.962603:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391383.962759:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130815872 00000100:00100000:2.0:1790391383.962763:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130815872 00000100:00100000:2.0:1790391383.962796:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130815616 00000100:00100000:2.0:1790391383.962798:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130815616 00000100:00100000:2.0:1790391383.962816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816000 00000100:00100000:2.0:1790391383.962818:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816000 00000100:00100000:2.0:1790391383.962830:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790391383.962835:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130815872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391383.962867:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130815872:12345-0@lo:400:kworker.0 Request processed in 32us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.962871:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790391383.962880:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790391383.962884:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130815616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391383.962905:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130815616:12345-0@lo:400:kworker.0 Request processed in 21us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.962939:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790391383.962951:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391383.962957:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130816000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391383.962990:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877361130816000:12345-0@lo:400:kworker.0 Request processed in 34us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.962994:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391383.963036:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816256 00000100:00100000:2.0:1790391383.963039:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816256 00000100:00100000:2.0:1790391383.963057:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790391383.963061:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130816256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391383.963093:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391383.963120:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130816256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.963124:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790391383.963149:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1877361130816000:0@lo:400:kworker.0 00000100:00100000:2.0:1790391383.963156:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130815616:0@lo:400:kworker.0 00000100:00100000:2.0:1790391383.963173:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130815872:0@lo:400:kworker.0 00000100:00100000:1.0:1790391383.963334:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130816256:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790391383.963422:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391383.963429:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391383.963432:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391384.333776:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391384.333990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108819712 00000100:00100000:2.0:1790391384.334003:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108819712 00000100:00100000:2.0:1790391384.334130:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 176 00000100:00100000:2.0:1790391384.334144:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2363:x1877361108819712:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391384.334250:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2363:x1877361108819712:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 108us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391384.334258:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 176 00000100:00080000:1.0:1790391384.334380:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391384.413558:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391385.435749:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790391385.595979:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:1.0:1790391385.595990:0:7657:0:(genops.c:885:class_export_put()) final put ffff962411a35000/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:2.0:1790391385.596088:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962411a35000/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f for lustre-OST0001 00000020:00000080:2.0:1790391385.596145:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962411a36800 for lustre-OST0001 00000100:00100000:3.0:1790391385.683255:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391385.683302:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391385.683347:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391385.688910:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108819968 00000100:00100000:1.0:1790391385.688927:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108819968 00000100:00100000:1.0:1790391385.689001:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108819840 00000100:00100000:1.0:1790391385.689004:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108819840 00000100:00100000:1.0:1790391385.689032:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108820096 00000100:00100000:1.0:1790391385.689036:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108820096 00000100:00100000:1.0:1790391385.689060:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:1.0:1790391385.689070:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+12:2366:x1877361108819968:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391385.689086:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391385.689105:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449a7a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc36 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391385.689125:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391385.689182:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+11:2366:x1877361108819968:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 113us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391385.689190:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:1.0:1790391385.689532:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:1.0:1790391385.689541:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+10:2366:x1877361108819840:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391385.689551:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391385.689561:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030600/0x35e94fc15449a79f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fc0c expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391385.689587:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391385.689610:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+9:2366:x1877361108819840:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 70us (6307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391385.689617:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:1.0:1790391385.689631:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:1.0:1790391385.689638:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+8:2366:x1877361108820096:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391385.689647:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391385.689656:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400031600/0x35e94fc15449a966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fcbb expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391385.689665:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391385.689683:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:656269f8-80d5-4ea5-97c7-0f2aef046604+7:2366:x1877361108820096:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 45us (6341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391385.689690:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:3.0:1790391385.700607:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391385.700740:0:11443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108820352 00000100:00100000:0.0:1790391385.700752:0:11443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108820352 00000100:00100000:0.0:1790391385.700839:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 241 00000100:00100000:0.0:1790391385.700861:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+6:2362:x1877361108820352:12345-192.168.201.8@tcp:39:umount.0 00000020:00000080:0.0:1790391385.700945:0:11443:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a7b4 00000020:00010000:0.0:1790391385.700957:0:11443:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962439926000: total 0 00000100:00080000:0.0:1790391385.701306:0:11443:0:(import.c:65:import_set_state_nolock()) ffff962439923800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790391385.701404:0:11443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1790391385.701732:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d03e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0b40030-8079-4d0d-add3-36e0ceb183ab+5:2362:x1877361108820352:12345-192.168.201.8@tcp:39:umount.0 Request processed in 880us (1138us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1790391385.701742:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 241 00000020:00010000:2.0:1790391385.706384:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962439926000: total 0 00010000:00010000:0.0:1790391385.709529:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962439926000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790391385.709597:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962411373300) 00010000:00010000:0.0:1790391385.709602:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391385.709619:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962412f10400/0x35e94fc15449b6e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2006c expref: 4 pid: 8292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391385.709654:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962439926000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790391385.709669:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391385.709671:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391385.709675:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391385.729733:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391385.730771:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108820608 00000100:00100000:0.0:1790391385.730791:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108820608 00000100:00100000:0.0:1790391385.730909:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 303 00000100:00100000:0.0:1790391385.730923:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+7:2362:x1877361108820608:12345-192.168.201.8@tcp:251:umount.0 00000020:00000080:0.0:1790391385.731217:0:5830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a6aa 00000020:00010000:0.0:1790391385.731228:0:5830:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96240e8df000: total 0 00000100:00080000:0.0:1790391385.731234:0:5830:0:(import.c:65:import_set_state_nolock()) ffff96240e8d9000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790391385.731341:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:656269f8-80d5-4ea5-97c7-0f2aef046604+3:2362:x1877361108820608:12345-192.168.201.8@tcp:251:umount.0 Request processed in 420us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391385.731350:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 303 00000020:00010000:1.0:1790391385.732477:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96240e8df000: total 0 00010000:00010000:1.0:1790391385.732485:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391385.732558:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96240e8df000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790391385.732605:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3000/0x35e94fc15449a760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f1fbfe expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391385.732623:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96240e8df000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790391385.732630:0:5824:0:(genops.c:885:class_export_put()) final put ffff96240e8df000/656269f8-80d5-4ea5-97c7-0f2aef046604 00010000:00010000:1.0:1790391385.732649:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391385.732651:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391385.732653:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790391385.732700:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96240e8df000/656269f8-80d5-4ea5-97c7-0f2aef046604 for MGS 00000020:00000080:0.0:1790391385.732750:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96240e8d9000 for MGS 00000100:00100000:2.0:1790391386.010578:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391386.020487:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130816384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391386.020605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391386.020790:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816384 00000100:00100000:1.0:1790391386.020820:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816384 00000100:00100000:1.0:1790391386.020912:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790391386.020924:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130816384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391386.020973:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391386.021060:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130816384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391386.021068:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1790391386.021333:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391386.021394:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130816384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391386.457504:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391387.483330:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391387.898298:0:12977:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1790391387.944213:0:12977:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1790391387.944285:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.944303:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.944310:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.944318:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.944357:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790391387.944365:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790391387.944400:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391387.944405:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790391387.944413:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790391387.944449:0:12977:0:(import.c:65:import_set_state_nolock()) ffff96243a7f3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790391387.944821:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130816512:0@lo:39:umount.0 00000100:00100000:3.0:1790391387.944970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.945094:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816512 00000100:00100000:3.0:1790391387.945103:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816512 00000100:00100000:3.0:1790391387.945176:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790391387.945186:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877361130816512:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790391387.945219:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a4b9 00000100:00080000:3.0:1790391387.945229:0:5837:0:(import.c:65:import_set_state_nolock()) ffff962407ad7000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790391387.945297:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1877361130816512:12345-0@lo:39:umount.0 Request processed in 112us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.945306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1790391387.945319:0:5837:0:(genops.c:885:class_export_put()) final put ffff962407ad0800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1790391387.945349:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391387.945359:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.945369:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1790391387.945374:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.945384:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391387.945393:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391387.945400:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391387.945403:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790391387.945407:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790391387.945442:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.945461:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391387.945483:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.945490:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31a00/0x35e94fc15449a72f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a736 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.945505:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391387.945507:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391387.945509:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391387.945542:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96243a7f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790391387.945551:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130816512:0@lo:39:umount.0 00000020:00000080:3.0:1790391387.945581:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962407ad0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790391387.945639:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962407ad7000 for lustre-MDT0000 00000100:00100000:3.0:1790391387.945656:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130816640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391387.945700:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.945743:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816640 00000100:00100000:3.0:1790391387.945748:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816640 00000100:00100000:3.0:1790391387.945780:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790391387.945787:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240312dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+19:3309:x1877361130816640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391387.945798:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391387.945813:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400031000/0x35e94fc15449a736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a72f expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.945827:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391387.945863:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240312dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c86877e-0672-4feb-acd6-39a38006ba27+18:3309:x1877361130816640:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.945880:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790391387.945937:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130816640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391387.946271:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391387.948086:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391387.948099:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790391387.948110:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790391387.956480:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956501:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956509:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956531:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956558:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391387.956565:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956572:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956579:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956585:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956595:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790391387.956603:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956610:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956617:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956623:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956640:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790391387.956645:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956651:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956657:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956663:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.956670:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1790391387.956673:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790391387.956700:0:12977:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790391387.956704:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790391387.956709:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391387.956715:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1790391387.956722:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96243fa37000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391387.956728:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96243f8f9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391387.956735:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff962439926000 d0b40030-8079-4d0d-add3-36e0ceb183ab 192.168.201.8@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391387.956740:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff96240e8da800 df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 192.168.201.8@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1790391387.956745:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9624125a19c0) has exports, disconnecting them 00000020:00080000:0.0:1790391387.956749:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96243fa37000), last request at 1790391383 00000020:00000080:0.0:1790391387.956756:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a62c 00000100:00080000:0.0:1790391387.956782:0:12977:0:(import.c:65:import_set_state_nolock()) ffff96243fa32000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790391387.956835:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96243fa37000): rc 0 00000020:00000080:0.0:1790391387.956838:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243fa37000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1790391387.956943:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790391387.956957:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.956970:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400030200 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1790391387.956975:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.956990:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391387.956999:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391387.957006:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391387.957008:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:01000000:3.0:1790391387.957011:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1790391387.957048:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1790391387.957130:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957139:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391387.957173:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957183:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962400030200/0x35e94fc15449a73d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a744 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957224:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391387.957230:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957237:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217a600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1790391387.957240:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957249:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957251:0:12978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1790391387.957268:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957271:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391387.957284:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790391387.957296:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790391387.957300:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790391387.957302:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391387.957310:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957320:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957323:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957352:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1790391387.957357:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391387.957365:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391387.957368:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790391387.957371:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790391387.957390:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957401:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96244217a600/0x35e94fc15449a958 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a95f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957409:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.957416:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391387.957421:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957422:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391387.957434:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957454:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391387.957463:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130816768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391387.957467:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31400/0x35e94fc15449a664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a66b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957492:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957494:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957498:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391387.957606:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130816896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391387.957675:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391387.957730:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391387.957737:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130817024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391387.957760:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391387.957817:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957828:0:12978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957835:0:12978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391387.957839:0:12978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957859:0:12978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391387.957865:0:12978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391387.957870:0:12978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391387.957872:0:12978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790391387.957881:0:12978:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790391387.957909:0:12978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957916:0:12978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391387.957924:0:12978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957930:0:12978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e30a00/0x35e94fc15449a418 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a41f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.957945:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957947:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957949:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957954:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391387.957956:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391387.957978:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816896 00000100:00100000:1.0:1790391387.957984:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816896 00000100:00100000:1.0:1790391387.958056:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817024 00000100:00100000:1.0:1790391387.958059:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817024 00000100:00100000:1.0:1790391387.958078:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391387.958091:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+19:3307:x1877361130816896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391387.958104:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391387.958119:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e31800/0x35e94fc15449a95f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a958 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.958132:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391387.958173:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+18:3307:x1877361130816896:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.958182:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790391387.958213:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391387.958217:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391387.958238:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+17:3307:x1877361130817024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391387.958251:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790391387.958256:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1790391387.958264:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412d8f800/0x35e94fc15449a66b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a664 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391387.958269:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130817152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391387.958291:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391387.958309:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391387.958346:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3307:x1877361130817024:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.958356:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790391387.958371:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130816768 00000100:00100000:1.0:1790391387.958374:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817152 00000100:00100000:3.0:1790391387.958380:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130816768 00000100:00100000:1.0:1790391387.958382:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817152 00000100:00100000:1.0:1790391387.958413:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391387.958423:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+17:3310:x1877361130817152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391387.958431:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391387.958442:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a1200/0x35e94fc15449a41f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a418 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.958453:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391387.958498:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130817024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391387.958929:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+16:3310:x1877361130817152:12345-0@lo:103:ldlm_bl.0 Request processed in 506us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.958938:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391387.958955:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391387.958963:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+15:3310:x1877361130816768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391387.958972:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391387.958981:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3400/0x35e94fc15449a744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a73d expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.958989:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391387.959053:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c86877e-0672-4feb-acd6-39a38006ba27+14:3310:x1877361130816768:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.959059:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00080000:0.0:1790391387.959523:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96243f8f9000), last request at 1790391383 00000020:00000080:0.0:1790391387.959553:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a5a0 00000100:00080000:0.0:1790391387.959562:0:12977:0:(import.c:65:import_set_state_nolock()) ffff96243f8ff000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790391387.959600:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96243f8f9000): rc 0 00000020:00000080:0.0:1790391387.959603:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243f8f9000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1790391387.959611:0:12977:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafe8c18bfae0 00000100:00080000:0.0:1790391387.959631:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790391387.959635:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1790391387.959649:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790391387.959718:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790391387.959739:0:12977:0:(import.c:65:import_set_state_nolock()) ffff962439719000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1790391387.959753:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790391387.959756:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1790391387.959765:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1790391387.959942:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243fa37000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1790391387.959985:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243f8f9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790391387.960008:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243fa32000 for lustre-MDT0000 00000020:00000080:1.0:1790391387.960013:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243f8ff000 for lustre-MDT0000 00000100:00100000:1.0:1790391387.960076:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130817280:0@lo:9:umount.0 00000100:00100000:1.0:1790391387.960123:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391387.960161:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391387.960978:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790391387.961001:0:12977:0:(import.c:65:import_set_state_nolock()) ffff962439f99800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1790391387.961066:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9624125a19c0) has no exports 00000100:00100000:2.0:1790391387.961481:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817280 00000100:00100000:2.0:1790391387.961498:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817280 00000100:00100000:2.0:1790391387.961580:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391387.961593:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1877361130817280:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790391387.961633:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a5ae 00000100:00080000:2.0:1790391387.961646:0:6695:0:(import.c:65:import_set_state_nolock()) ffff96243f7bd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391387.961697:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790391387.962004:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3306:x1877361130817280:12345-0@lo:9:umount.0 Request processed in 412us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391387.962045:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1790391387.962077:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391387.962134:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130817152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391387.962148:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130816768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391387.962348:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130816896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391387.962359:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130817408:0@lo:9:umount.0 00000100:00100000:1.0:1790391387.962422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391387.962489:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962439719000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790391387.962510:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790391387.962515:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790391387.962523:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130817280:0@lo:9:umount.0 00000100:00100000:1.0:1790391387.962583:0:8917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817408 00000100:00100000:1.0:1790391387.962591:0:8917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817408 00000100:00100000:1.0:1790391387.962665:0:8917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790391387.962676:0:8917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1877361130817408:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790391387.962703:0:8917:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a695 00000100:00080000:1.0:1790391387.962713:0:8917:0:(import.c:65:import_set_state_nolock()) ffff96243fa35000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391387.962751:0:8917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1790391387.963448:0:8917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3306:x1877361130817408:12345-0@lo:9:umount.0 Request processed in 769us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.963459:0:8917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1790391387.963525:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962439f99800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1790391387.963535:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790391387.963555:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790391387.963558:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790391387.963563:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130817408:0@lo:9:umount.0 00000100:00080000:2.0:1790391387.964460:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1790391387.989503:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9624125a19c0) has no exports 00000020:00000080:0.0:1790391388.055949:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a473 00000020:00000080:0.0:1790391388.055965:0:12977:0:(genops.c:885:class_export_put()) final put ffff96242d067000/lustre-QMT0000_UUID 00000020:01000000:0.0:1790391388.055989:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1790391388.056203:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96242d067000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790391388.056318:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391388.058623:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790391388.058638:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff96241ffbcd40) has no exports 00000020:00000080:1.0:1790391388.060911:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a46c 00000020:00000080:1.0:1790391388.060931:0:12977:0:(genops.c:885:class_export_put()) final put ffff96241ffc0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790391388.061155:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96241ffc0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790391388.061310:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391388.061326:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790391388.061331:0:12977:0:(genops.c:885:class_export_put()) final put ffff962427f48000/lustre-QMT0000_UUID 00000020:00000080:1.0:1790391388.061333:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff962427f48000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1790391388.061341:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:2.0:1790391388.165516:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0b40030-8079-4d0d-add3-36e0ceb183ab 00000001:00080000:2.0:1790391388.165549:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1790391388.165557:0:5859:0:(genops.c:885:class_export_put()) final put ffff962439926000/d0b40030-8079-4d0d-add3-36e0ceb183ab 00000001:00080000:2.0:1790391388.165601:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:2.0:1790391388.165613:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000001:00080000:2.0:1790391388.165621:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1790391388.165632:0:5859:0:(genops.c:885:class_export_put()) final put ffff96240e8da800/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:1.0:1790391388.165760:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962439926000/d0b40030-8079-4d0d-add3-36e0ceb183ab for lustre-MDT0000 00000020:00000080:1.0:1790391388.165856:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96240e8da800/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f for lustre-MDT0000 00000020:00000080:1.0:1790391388.165892:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962439923800 for lustre-MDT0000 00000020:00000080:1.0:1790391388.165899:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96240e8da000 for lustre-MDT0000 00010000:00010000:1.0:1790391388.509976:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790391388.636082:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:3.0:1790391388.636097:0:6726:0:(genops.c:885:class_export_put()) final put ffff962403a85000/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f 00000020:00000080:1.0:1790391388.636262:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff962403a85000/df1f42ea-d1a5-4c29-a24b-54fd63c9ff4f for lustre-OST0000 00000020:00000080:1.0:1790391388.636337:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962403a85800 for lustre-OST0000 00000001:00100000:3.0:1790391388.636399:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790391388.636404:0:6726:0:(genops.c:885:class_export_put()) final put ffff96243f7ba800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790391388.636481:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243f7ba800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790391388.636548:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243f7bd000 for lustre-OST0000 00000100:00100000:3.0:1790391389.081857:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130817536:0@lo:400:kworker.0 00000100:00100000:3.0:1790391389.081964:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391389.082224:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130817664:0@lo:400:kworker.0 00000100:00100000:2.0:1790391389.082274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391389.082328:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391389.082334:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130817792:0@lo:400:kworker.0 00000100:00100000:2.0:1790391389.082356:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391389.082389:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817664 00000100:00100000:2.0:1790391389.082397:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817664 00000100:00100000:2.0:1790391389.082432:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817792 00000100:00100000:2.0:1790391389.082435:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817792 00000100:00100000:2.0:1790391389.082453:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790391389.082461:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1877361130817664:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790391389.082469:0:8292:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790391389.082510:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1877361130817664:12345-0@lo:400:kworker.0 Request processed in 48us (234us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391389.082517:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790391389.082550:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1790391389.082555:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1877361130817792:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790391389.082560:0:8292:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790391389.082583:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1877361130817792:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391389.082590:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1790391389.082632:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790391389.082637:0:3307:0:(import.c:65:import_set_state_nolock()) ffff96243fa31800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790391389.082641:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1790391389.089311:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817536 00000100:00100000:0.0:1790391389.089329:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817536 00000100:00100000:0.0:1790391389.089405:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790391389.089415:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:3310:x1877361130817536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391389.089663:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c86877e-0672-4feb-acd6-39a38006ba27+14:3310:x1877361130817536:12345-0@lo:400:kworker.0 Request processed in 248us (7698us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391389.089671:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790391389.089820:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c86877e-0672-4feb-acd6-39a38006ba27:3310:1877361130817536:0@lo:400:kworker.0 00000100:00080000:2.0:1790391389.103771:0:3307:0:(import.c:65:import_set_state_nolock()) ffff96243fa31800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391389.103786:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 230 00000100:00080000:2.0:1790391389.103797:0:3307:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96243fa31800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391389.103848:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439725180 x1877361130817920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391389.106481:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130817792:0@lo:400:kworker.0 00000100:00080000:2.0:1790391389.106532:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790391389.106538:0:3307:0:(import.c:65:import_set_state_nolock()) ffff96243a4bf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790391389.106542:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790391389.106546:0:3307:0:(import.c:65:import_set_state_nolock()) ffff96243a4bf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391389.106550:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 211 00000100:00080000:2.0:1790391389.106560:0:3307:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96243a4bf800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391389.106600:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439724000 x1877361130818048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391389.106613:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130817664:0@lo:400:kworker.0 00000100:00100000:1.0:1790391389.108501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130817920:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790391389.108593:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391389.108638:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1877361130818048:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790391389.108660:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391389.109056:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130817920 00000100:00100000:2.0:1790391389.109066:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130817920 00000100:00100000:2.0:1790391389.109110:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130818048 00000100:00100000:2.0:1790391389.109113:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130818048 00000100:00100000:2.0:1790391389.109144:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790391389.109151:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1877361130817920:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1790391389.109167:0:8292:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790391389.112110:0:11443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790391389.112122:0:11443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1877361130818048:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1790391389.112159:0:11443:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790391389.112253:0:11443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1877361130818048:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 130us (3590us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391389.112261:0:11443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1790391389.112323:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96243a4bf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391389.112330:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391389.112334:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1877361130818048:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1790391389.121445:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1877361130817920:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 12274us (12833us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391389.121461:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1790391389.125450:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96243fa31800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391389.125464:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391389.125468:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130817920:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1790391389.529714:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790391390.105208:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff962439ea34e0 - data ffff962409b4d5e8/ffff962439f1f400 00000020:01000000:1.0:1790391390.105366:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff962402cb2a20 - data ffff96242bafa360/ffff962427ceec00 00000001:00000004:1.0:1790391390.123159:0:12977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1790391390.262869:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790391390.262879:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1790391390.263127:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391390.263131:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790391390.269308:0:6713:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790391390.269330:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1790391390.269347:0:6713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790391390.270483:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790391390.270491:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1790391390.270513:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790391390.270516:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790391390.271662:0:8083:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790391390.271668:0:8083:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1790391390.271678:0:8083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790391390.430962:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a43b 00000020:00000080:0.0:1790391390.430980:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243a7f6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790391390.432528:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a450 00000020:00000080:0.0:1790391390.432540:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243a6e8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391390.432599:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a7f6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1790391390.432921:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790391390.432969:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391390.432981:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790391390.432987:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9624125a0000) has no exports 00000004:01000000:0.0:1790391390.433228:0:12977:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790391390.433240:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a68e 00000020:00000080:0.0:1790391390.433246:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243fa33000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391390.433296:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a6e8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790391390.433358:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790391390.433363:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391390.433371:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790391390.433374:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff96243a7fb380) has no exports 00000020:00000080:0.0:1790391390.433384:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a687 00000020:00000080:0.0:1790391390.433389:0:12977:0:(genops.c:885:class_export_put()) final put ffff962439f9f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391390.433405:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243fa33000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1790391390.433883:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790391390.433890:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790391390.433895:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1790391390.433903:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790391390.433906:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790391390.433936:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff962439f9f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790391390.434056:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391390.434083:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391390.434090:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a51b 00000020:00000080:0.0:1790391390.434096:0:12977:0:(genops.c:885:class_export_put()) final put ffff96241f2cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391390.434264:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962439f99800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790391390.434273:0:12654:0:(genops.c:885:class_export_put()) final put ffff962427e85800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391390.434283:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff962427e85800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790391390.434289:0:12654:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790391390.434467:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790391390.434472:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391390.434478:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790391390.434481:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff96241ffbb380) has no exports 00000020:00000080:0.0:1790391390.434487:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a514 00000020:00000080:0.0:1790391390.434491:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243971b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391390.434507:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96241f2cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1790391390.434983:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790391390.434988:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790391390.434992:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1790391390.434997:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790391390.434999:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790391390.435046:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243971b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790391390.435154:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391390.435161:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391390.435196:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391390.435199:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391390.435203:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243a7f3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790391390.435206:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a7f3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790391390.435212:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391390.435410:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a457 00000020:00000080:0.0:1790391390.435417:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243a6ee800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790391390.435441:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962439719000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790391390.435447:0:12654:0:(genops.c:885:class_export_put()) final put ffff96243982c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790391390.435449:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243982c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790391390.435454:0:12654:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790391390.435607:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1790391390.435612:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391390.435617:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790391390.435620:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff96243a7f99c0) has no exports 00000020:00000080:0.0:1790391390.435642:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391390.435645:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790391390.435649:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a45e 00000020:00000080:0.0:1790391390.435654:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243a6ed800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391390.435673:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a6ee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790391390.435677:0:12654:0:(genops.c:885:class_export_put()) final put ffff96243a7f4000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790391390.435680:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a7f4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790391390.435683:0:12654:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1790391390.435920:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624081bf000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790391390.435935:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624081bf000 3 00000020:01000004:0.0:1790391390.435939:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9624081bf000 from lustre-MDT0000 00000020:00000080:0.0:1790391390.435978:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391390.435983:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790391390.435987:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243a7f5800/lustre-MDT0000_UUID 00000020:00000080:0.0:1790391390.435990:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a7f5800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790391390.435998:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790391390.436063:0:12977:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1790391390.436068:0:12977:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790391390.436071:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790391390.436074:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391390.436078:0:12977:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790391390.436085:0:12977:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff962410f69000 2c86877e-0672-4feb-acd6-39a38006ba27 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391390.436091:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9624125a3380) has exports, disconnecting them 00000020:00080000:0.0:1790391390.436097:0:12977:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff962410f69000), last request at 1790391157 00000020:00000080:0.0:1790391390.436114:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a3fc 00000020:00010000:0.0:1790391390.436119:0:12977:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962410f69000: total 1 00000100:00080000:0.0:1790391390.436124:0:12977:0:(import.c:65:import_set_state_nolock()) ffff962410f6e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790391390.436225:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962410f69000): rc 0 00000020:00080000:0.0:1790391390.436230:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9624125a3380) has no exports 00000100:00100000:0.0:1790391390.436302:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff962408377a00:5830] 1 exiting: rc = 0 00000100:00100000:0.0:1790391390.436421:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff962411ab8600:5831] 2 exiting: rc = 0 00000020:00000080:1.0:1790391390.436568:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a6ed800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1790391390.436600:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962410f69000: total 0 00010000:00010000:3.0:1790391390.436672:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962410f69000, canceled 0 locks, left on hash table 8. 00000100:00100000:2.0:1790391390.436695:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96240e948600:5829] 0 exiting: rc = 1 00010000:00010000:3.0:1790391390.436714:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a0a00/0x35e94fc15449a6fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a6f7 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391390.436785:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436796:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436815:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436830:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436838:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436849:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436861:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436876:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436884:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436897:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436930:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436941:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436951:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436964:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436978:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.436998:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437008:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437164:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437214:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437222:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437230:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437239:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437245:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437251:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437259:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437265:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437271:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437277:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437283:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437290:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437296:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437302:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437309:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437315:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437320:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437326:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437331:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437337:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437343:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437348:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437353:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437358:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437364:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437369:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437375:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437390:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437395:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437401:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437407:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437412:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437417:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437424:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437430:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437436:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437442:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437448:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437455:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437462:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437468:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437474:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437480:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437487:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437493:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.437499:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1790391390.440633:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962400030800/0x35e94fc15449a70c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a705 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391390.440657:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a1800/0x35e94fc15449a71a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a713 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391390.440672:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962415e30200/0x35e94fc15449a728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a721 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391390.440688:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9624013a0600/0x35e94fc15449a54c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a53e expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391390.440712:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412f11200/0x35e94fc15449a943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a93c expref: 4 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391390.440724:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2a00/0x35e94fc15449a951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a94a expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391390.440746:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2600/0x35e94fc15449a752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x35e94fc15449a74b expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391390.440761:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962410f69000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1790391390.440835:0:5825:0:(genops.c:885:class_export_put()) final put ffff962410f69000/2c86877e-0672-4feb-acd6-39a38006ba27 00010000:00010000:3.0:1790391390.440860:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391390.440863:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790391390.440945:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff962410f69000/2c86877e-0672-4feb-acd6-39a38006ba27 for MGS 00000020:00000080:1.0:1790391390.441008:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962410f6e000 for MGS 20000000:01000000:0.0:1790391390.441240:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790391390.441245:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:3.0:1790391390.441555:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790391390.442871:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff962439ea3ae0 - data ffff962409572bd0/ffff962439f1e800 00000020:01000000:0.0:1790391390.462063:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96241bfc6c60 - data ffff96242bba8360/ffff962427f1e400 00000020:00000080:3.0:1790391390.462703:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a3e0 00000020:00000080:3.0:1790391390.462723:0:12977:0:(genops.c:885:class_export_put()) final put ffff962410f6a800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790391390.462751:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9624081bf000 from MGS, refs=2 00000020:01000004:3.0:1790391390.462755:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624081bf000 2 00000020:01000004:3.0:1790391390.462759:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9624081bf000 from MGS 00000020:00000080:3.0:1790391390.462784:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391390.462791:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1790391390.462793:0:12977:0:(genops.c:885:class_export_put()) final put ffff962410f6b000/MGS 00000020:00000080:3.0:1790391390.462796:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff962410f6b000/MGS for MGS 00000020:01000000:3.0:1790391390.462812:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1790391390.462874:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1790391390.462878:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391390.462885:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790391390.462894:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff962407ad2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790391390.462900:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff96243a7fcd40) has exports, disconnecting them 00000020:00080000:3.0:1790391390.462905:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff962407ad2000), last request at 1790391157 00000020:00000080:3.0:1790391390.462909:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a4ab 00000020:00080000:3.0:1790391390.462920:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962407ad2000): rc 0 00000020:00000080:3.0:1790391390.462926:0:12977:0:(genops.c:885:class_export_put()) final put ffff962407ad2000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790391390.463616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962410f6a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790391390.463632:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962407ad2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1790391390.479443:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1790391390.479451:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391390.479456:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790391390.479464:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790391390.479670:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243a7f3800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790391390.479825:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391390.479835:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790391390.479840:0:12977:0:(genops.c:885:class_export_put()) final put ffff96243a6eb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790391390.479844:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a6eb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790391390.479851:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1790391390.479910:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9624081bf000 1 00000020:00000080:3.0:1790391390.479916:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a3d2 00000020:00000080:3.0:1790391390.479922:0:12977:0:(genops.c:885:class_export_put()) final put ffff962410f68800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1790391390.479970:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1790391390.479984:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391390.479989:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790391390.479993:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9624125a4d40) has no exports 00000020:00000080:0.0:1790391390.480727:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962410f68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790391390.549172:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391390.549189:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790391390.549195:0:12977:0:(genops.c:885:class_export_put()) final put ffff9624081b8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391390.549200:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff9624081b8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790391390.549210:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790391390.549355:0:12977:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9624081bb800 00000020:01000000:1.0:1790391390.549381:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790391390.549385:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391390.549391:0:12977:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790391390.549396:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff962427f44d40) has no exports 00000100:00100000:1.0:1790391390.549490:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff962412444c00:5836] 0 exiting: rc = 1 00000100:00100000:1.0:1790391390.549622:0:11443:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff96240e806e00:11443] 4 exiting: rc = 0 00000100:00100000:2.0:1790391390.550465:0:8292:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff96243f6e3000:8292] 3 exiting: rc = 0 00000100:00100000:0.0:1790391390.551100:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9624031f9a00:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1790391390.551165:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff962412b54200:5838] 2 exiting: rc = 0 00000100:00100000:1.0:1790391390.551291:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551335:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551341:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551346:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551353:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551359:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551365:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551370:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551375:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551380:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551386:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551414:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551423:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551431:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551438:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551443:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551450:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551456:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551461:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551466:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551473:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551479:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551485:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551491:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551497:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551503:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551508:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551514:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551520:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551527:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551544:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551552:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551558:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551565:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551571:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551577:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551590:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551595:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551601:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551607:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551613:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551618:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551623:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551628:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551634:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551641:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551647:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551652:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551658:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551664:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551669:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551675:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551682:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551687:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551694:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551699:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551705:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551710:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551716:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551721:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551727:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551732:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551738:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.551754:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.565033:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff962411134c00:5840] 1 exiting: rc = 0 00000100:00100000:1.0:1790391390.565412:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff962411135c00:5839] 0 exiting: rc = 1 00000100:00100000:1.0:1790391390.565495:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565504:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565512:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565518:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565525:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565646:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565676:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565683:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565689:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565695:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565702:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565708:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565715:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565720:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565725:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565729:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565734:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565739:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565743:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565748:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565752:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565757:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565762:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565766:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565772:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565778:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565783:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565788:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565794:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565810:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565817:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565823:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565828:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565833:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565839:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565844:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565849:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565854:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565859:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565864:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565870:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565882:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565889:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565894:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565899:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565904:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565910:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565914:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565919:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565923:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565929:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565934:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565939:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565944:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565950:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565955:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565960:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565965:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565970:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565974:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565980:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565986:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565990:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.565995:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1790391390.567711:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391390.567882:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff962411134800:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1790391390.568201:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff962411134600:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1790391390.568670:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568679:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568687:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568693:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568699:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568715:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568724:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568732:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568739:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568745:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568750:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568755:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568761:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568770:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568776:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568781:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568787:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568820:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568828:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568834:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568841:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568850:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568856:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568862:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568868:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568873:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568879:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568885:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568891:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568914:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568922:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568939:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568946:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568952:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568958:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568971:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568978:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568989:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.568996:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569002:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569011:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569067:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569075:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569084:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569090:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569096:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569102:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569108:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569114:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569120:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569126:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569131:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569137:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569159:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569166:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569172:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569178:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569184:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569190:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569196:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569202:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569209:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569214:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.569220:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.582292:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff962411135200:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1790391390.589155:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff962411135a00:5844] 1 exiting: rc = 0 00000100:00100000:3.0:1790391390.589429:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589437:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589460:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589465:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589470:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589476:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589481:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589486:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589491:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589496:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589501:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589507:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589512:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589517:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589522:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589527:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589543:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589550:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589556:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589561:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589566:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589571:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589576:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589581:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589586:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589591:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589597:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589602:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589607:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589612:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589617:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589621:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589627:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589632:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589637:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589642:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589647:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589659:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589664:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589669:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589674:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589678:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589683:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589688:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589693:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589697:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589703:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589708:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589713:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589718:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589723:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589728:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589734:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589739:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589744:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589748:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589754:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589759:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589764:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589769:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589775:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589781:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589786:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.589791:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.590386:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff962411134400:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1790391390.590519:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff962411135000:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1790391390.591159:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591166:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591172:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591178:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591183:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591189:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591194:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591199:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591218:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591225:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591232:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591237:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591242:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591247:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591253:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591257:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591263:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591269:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591274:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591279:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591285:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591290:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591295:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591300:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591305:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591310:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591326:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591333:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591339:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591344:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591349:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591354:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591359:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591363:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591367:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591373:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591378:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591383:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591389:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591395:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591492:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591501:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591506:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591519:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591524:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591529:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591649:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591657:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591662:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591666:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591671:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591676:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591683:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591687:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591692:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591696:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591701:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591705:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591710:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591714:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591718:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591723:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591727:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.591733:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391390.592997:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff962427f63e00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1790391390.593603:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff962427f62600:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1790391390.593817:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593825:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593830:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593836:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593841:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593847:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593852:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593858:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593864:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593868:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593873:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593881:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593887:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593892:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593909:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593914:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593919:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593924:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593929:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593933:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593938:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593943:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593949:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593955:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593960:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593965:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593971:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593976:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593981:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593986:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593991:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.593995:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594000:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594005:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594011:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594045:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594052:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594057:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594063:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594068:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594073:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594078:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594083:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594088:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594093:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594098:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594103:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594108:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594114:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594126:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594131:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594135:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594140:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594145:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594150:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594154:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594159:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594164:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594169:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594175:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594180:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594184:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594189:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.594195:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391390.595088:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff962427f79200:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1790391390.595274:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff962427f74c00:5851] 2 exiting: rc = 0 00000100:00100000:0.0:1790391390.595669:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff962427f79c00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1790391390.595837:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595845:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595861:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595866:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595879:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595891:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595902:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595914:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595947:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595954:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595960:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595966:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595971:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595977:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595982:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595987:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595993:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.595998:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596004:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596010:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596061:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596066:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596071:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596076:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596081:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596087:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596092:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596097:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596102:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596108:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596114:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596121:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596142:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596149:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596156:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596161:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596167:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596173:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596178:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596184:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596191:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596196:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596202:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596207:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596213:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596218:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596224:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596230:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596239:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596244:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596250:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596255:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596261:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596266:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596271:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596286:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596308:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596361:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596367:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596373:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596379:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596385:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596391:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391390.596397:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790391390.605130:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391390.605148:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1790391390.605155:0:12977:0:(genops.c:885:class_export_put()) final put ffff962411aac800/MDS_uuid 00000020:00000080:3.0:1790391390.605160:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff962411aac800/MDS_uuid for MDS 00000020:01000000:3.0:1790391390.605169:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1790391390.605296:0:12977:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1790391390.702239:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790391390.702247:0:7657:0:(genops.c:885:class_export_put()) final put ffff96243fa37800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790391390.702273:0:12654:0:(genops.c:844:class_export_destroy()) destroying export ffff96243fa37800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790391390.702313:0:12654:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243fa35000 for lustre-OST0001 00010000:00010000:1.0:1790391391.578210:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391392.605141:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790391393.555929:0:13135:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1790391393.575181:0:13135:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790391393.575286:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.575301:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.575308:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.575315:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.575334:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790391393.575340:0:13135:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790391393.575372:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391393.575378:0:13135:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790391393.575383:0:13135:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790391393.575389:0:13135:0:(import.c:65:import_set_state_nolock()) ffff96243a4bf800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790391393.575394:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391393.575396:0:13135:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790391393.575399:0:13135:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790391393.576297:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576308:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576314:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576334:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576355:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790391393.576361:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576368:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576374:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576380:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576397:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1790391393.576400:0:13135:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790391393.576417:0:13135:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790391393.576421:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1790391393.576436:0:12979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790391393.576443:0:12979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576449:0:12979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391393.576453:0:12979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576461:0:12979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391393.576474:0:12979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391393.576480:0:12979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790391393.576482:0:12979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790391393.576485:0:12979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790391393.576522:0:12979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576529:0:12979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391393.576552:0:12979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576559:0:12979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962400031e00/0x35e94fc15449a713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a71a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576571:0:12979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391393.576575:0:12979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576580:0:12979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391393.576583:0:12979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576589:0:12979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391393.576594:0:12979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391393.576608:0:12979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790391393.576610:0:12979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790391393.576611:0:12979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790391393.576624:0:12979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576630:0:12979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391393.576636:0:12979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576642:0:12979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9624013a0400/0x35e94fc15449a721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a728 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576652:0:12979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391393.576655:0:12979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576659:0:12979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217b400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391393.576662:0:12979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576668:0:12979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391393.576674:0:12979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391393.576678:0:12979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790391393.576680:0:12979:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790391393.576681:0:12979:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790391393.576699:0:12979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576704:0:12979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391393.576719:0:12979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576726:0:12979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96244217b400/0x35e94fc15449a94a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x35e94fc15449a951 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391393.576737:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391393.576738:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391393.576740:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391393.576771:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130818176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391393.576839:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391393.576888:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391393.576895:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130818304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391393.576917:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391393.576943:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130818432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391393.576967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391393.577001:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130818176 00000100:00100000:2.0:1790391393.577007:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130818176 00000100:00100000:2.0:1790391393.577057:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130818304 00000100:00100000:2.0:1790391393.577060:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130818304 00000100:00100000:2.0:1790391393.577068:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130818432 00000100:00100000:2.0:1790391393.577070:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130818432 00000100:00100000:2.0:1790391393.577082:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391393.577089:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1877361130818176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790391393.577095:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391393 with bad export cookie 3884723845345158140 00010000:00010000:3.0:1790391393.578410:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790391393.578459:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391393.578470:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391393.578475:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff96241ffb8000) has no exports 00000020:00080000:3.0:1790391393.578508:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff96241ffb8000) has no exports 00010000:00010000:1.0:1790391393.578744:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391393.582789:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1877361130818176:12345-0@lo:103:ldlm_bl.0 Request processed in 5691us (5941us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391393.582816:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1790391393.582872:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.108@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790391393.582878:0:3309:0:(import.c:65:import_set_state_nolock()) ffff962410f6f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790391393.582882:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:3.0:1790391393.586096:0:13135:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff962439f21c60 - data ffff9624094045e8/ffff96242da53800 00000020:01000000:3.0:1790391393.587110:0:13135:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff962427c3af60 - data ffff962409445ca8/ffff96243f90f800 00000100:00080000:2.0:1790391393.587517:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.108@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790391393.587522:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790391393.587533:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff962439724e00 x1877361130818176/t0(0) o103->MGC192.168.201.108@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391409 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391393.587547:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff962439726a00 x1877361130818304/t0(0) o103->MGC192.168.201.108@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391409 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391393.587557:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff962439724380 x1877361130818432/t0(0) o103->MGC192.168.201.108@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391409 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790391393.587573:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790391393.587576:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790391393.587577:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790391393.587581:0:3309:0:(import.c:65:import_set_state_nolock()) ffff962410f6f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391393.587585:0:3309:0:(import.c:545:import_select_connection()) MGC192.168.201.108@tcp: connect to NID 0@lo last attempt 192 00000100:00080000:2.0:1790391393.587593:0:3309:0:(import.c:665:import_select_connection()) MGC192.168.201.108@tcp: import ffff962410f6f000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391393.587625:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c86877e-0672-4feb-acd6-39a38006ba27:3307:1877361130818432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391393.587679:0:3309:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439724380 x1877361130818560/t0(0) o250->MGC192.168.201.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391393.587713:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c86877e-0672-4feb-acd6-39a38006ba27:3306:1877361130818560:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1790391393.587772:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361130818560 offset 0 length 520: 4 00000100:00100000:2.0:1790391393.587830:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130818304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391393.587836:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c86877e-0672-4feb-acd6-39a38006ba27:3309:1877361130818176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391393.587881:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391393.587889:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1877361130818304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790391393.587896:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391393 with bad export cookie 3884723845345158140 00000400:00000100:2.0:1790391393.587930:0:5822:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1877361130818304 offset 224 length 224: 4 00000100:00100000:2.0:1790391393.587942:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1877361130818304:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (11024us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391393.587949:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391393.587971:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790391393.587976:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96240312fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1877361130818432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790391393.587981:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391393 with bad export cookie 3884723845345158140 00000400:00000100:2.0:1790391393.587996:0:5822:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1877361130818432 offset 224 length 224: 4 00000100:00100000:2.0:1790391393.588005:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96240312fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1877361130818432:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (11038us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391393.588011:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00100000:10000000:2.0:1790391393.603008:0:13135:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:2.0:1790391393.625646:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790391393.633889:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a56f 00000020:00000080:2.0:1790391393.633897:0:13135:0:(genops.c:885:class_export_put()) final put ffff96243971d000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790391393.633941:0:13135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962439f98800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790391393.633943:0:13135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962439f98800 2 00000020:01000004:2.0:1790391393.633946:0:13135:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962439f98800 from lustre-OST0000 00000020:00000080:2.0:1790391393.633965:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391393.633972:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790391393.633974:0:13135:0:(genops.c:885:class_export_put()) final put ffff96243971e000/lustre-OST0000_UUID 00000020:00000080:2.0:1790391393.633976:0:13135:0:(genops.c:844:class_export_destroy()) destroying export ffff96243971e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790391393.633980:0:13135:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790391393.634039:0:13135:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790391393.634052:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790391393.634056:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391393.634061:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790391393.634067:0:13135:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96243f8fb000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391393.634072:0:13135:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff962427f43380) has exports, disconnecting them 00000020:00080000:2.0:1790391393.634076:0:13135:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96243f8fb000), last request at 1790391175 00000020:00000080:2.0:1790391393.634080:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a599 00000020:00080000:2.0:1790391393.634087:0:13135:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96243f8fb000): rc 0 00000020:00000080:2.0:1790391393.634091:0:13135:0:(genops.c:885:class_export_put()) final put ffff96243f8fb000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790391393.634378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96243971d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790391393.634906:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96243f8fb000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790391393.637538:0:13135:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790391393.637545:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391393.637549:0:13135:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790391393.637554:0:13135:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391393.637734:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391393.637743:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1790391393.637771:0:13135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962439f98800 1 00000020:00000080:3.0:1790391393.637778:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a4dc 00000020:00000080:3.0:1790391393.637785:0:13135:0:(genops.c:885:class_export_put()) final put ffff962439f9c000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1790391393.637791:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1790391393.637794:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391393.637798:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790391393.637802:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff962427f0cd40) has no exports 00000020:00000080:1.0:1790391393.638216:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243a4bf800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790391393.638223:0:37:0:(genops.c:885:class_export_put()) final put ffff96243a4bc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790391393.638226:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a4bc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790391393.638234:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790391393.638286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962439f9c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790391393.662893:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391393.662910:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790391393.662916:0:13135:0:(genops.c:885:class_export_put()) final put ffff962439f9e000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790391393.662921:0:13135:0:(genops.c:844:class_export_destroy()) destroying export ffff962439f9e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790391393.662930:0:13135:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790391393.663097:0:13135:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962439f9a000 00000020:02000400:1.0:1790391393.663146:0:13135:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1790391394.201330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c86877e-0672-4feb-acd6-39a38006ba27->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391394.201341:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2c86877e-0672-4feb-acd6-39a38006ba27->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391394.201345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391394.201349:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790391394.201353:0:37:0:(import.c:65:import_set_state_nolock()) ffff96243fa31800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391394.201362:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1790391394.201369:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391394.201376:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96243fa31800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391394.201418:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439727100 x1877361130818688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391394.201463:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130818688:0@lo:38:kworker.0 00000400:00000100:2.0:1790391394.201514:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361130818688 offset 0 length 520: 4 00010000:00010000:2.0:1790391394.662104:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391395.677125:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790391396.501628:0:13284:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1790391396.514141:0:13284:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790391396.514226:0:13284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.514259:0:13284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.514266:0:13284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.514273:0:13284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.514304:0:13284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790391396.514310:0:13284:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790391396.514331:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391396.514343:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff962439727100 x1877361130818688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391396.514367:0:13284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790391396.514373:0:13284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790391396.514379:0:13284:0:(import.c:65:import_set_state_nolock()) ffff96243fa31800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790391396.514384:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391396.514388:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff962439727100 x1877361130818688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391409 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391396.514395:0:13284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790391396.514398:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1790391396.514907:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130818688:0@lo:38:kworker.0 00010000:00010000:1.0:1790391396.515063:0:12978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391396.515071:0:12978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.515079:0:12978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391396.515083:0:12978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.515092:0:12978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391396.515099:0:12978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391396.515104:0:12978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391396.515106:0:12978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790391396.515108:0:12978:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790391396.515121:0:12978:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962410f6f000 00010000:00010000:1.0:1790391396.515133:0:12978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.515139:0:12978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449a6f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a6fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.515149:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391396.515150:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391396.515152:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391396.516280:0:13284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516294:0:13284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516314:0:13284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516322:0:13284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516343:0:13284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391396.516350:0:13284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516357:0:13284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516363:0:13284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516370:0:13284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.516393:0:13284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790391396.516397:0:13284:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790391396.516417:0:13284:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790391396.516422:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790391396.516426:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391396.516432:0:13284:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790391396.516436:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff962427f419c0) has no exports 00010000:00010000:3.0:1790391396.516596:0:12979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391396.516603:0:12979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.516612:0:12979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1790391396.516616:0:12979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.516625:0:12979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391396.516632:0:12979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391396.516637:0:12979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391396.516640:0:12979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1790391396.516642:0:12979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1790391396.516652:0:12979:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962410f6f000 00010000:00010000:3.0:1790391396.516656:0:12979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.516749:0:12979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff9624013a1a00/0x35e94fc15449a705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a70c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.516768:0:12979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391396.516771:0:12979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.516777:0:12979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96244217a400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1790391396.516781:0:12979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.517042:0:12979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391396.517052:0:12979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391396.517057:0:12979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790391396.517059:0:12979:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790391396.517061:0:12979:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790391396.517067:0:12979:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962410f6f000 00010000:00010000:3.0:1790391396.517071:0:12979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.517078:0:12979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96244217a400/0x35e94fc15449a93c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a943 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.517094:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391396.517095:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391396.517097:0:12979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391396.517193:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790391396.517392:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff962427f419c0) has no exports 00000020:01000000:3.0:1790391396.524449:0:13284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff962439f21000 - data ffff96242bafae58/ffff96242da51400 00000020:01000000:3.0:1790391396.524597:0:13284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9624030f9f60 - data ffff9624097de6c0/ffff962439e90800 00100000:10000000:3.0:1790391396.537621:0:13284:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790391396.583717:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a5fb 00000020:00000080:1.0:1790391396.583728:0:13284:0:(genops.c:885:class_export_put()) final put ffff96243a4b8800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790391396.583750:0:13284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96243f8f8000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790391396.583753:0:13284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96243f8f8000 2 00000020:01000004:1.0:1790391396.583757:0:13284:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96243f8f8000 from lustre-OST0001 00000020:00000080:1.0:1790391396.583787:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391396.583797:0:13284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790391396.583801:0:13284:0:(genops.c:885:class_export_put()) final put ffff96243a4bd800/lustre-OST0001_UUID 00000020:00000080:1.0:1790391396.583805:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a4bd800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790391396.583811:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790391396.584001:0:13284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2c86877e-0672-4feb-acd6-39a38006ba27->MGS 00010000:00010000:1.0:1790391396.584049:0:13284:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a54c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391396.584062:0:13284:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a54c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391396.584068:0:13284:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790391396.584072:0:13284:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790391396.584075:0:13284:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790391396.584091:0:13284:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962410f6f000 00010000:00010000:1.0:1790391396.584106:0:13284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412d8ec00/0x35e94fc15449a53e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a54c expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.584123:0:13284:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x35e94fc15449a752 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391396.584130:0:13284:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x35e94fc15449a752 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391396.584136:0:13284:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391396.584138:0:13284:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790391396.584140:0:13284:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790391396.584150:0:13284:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962410f6f000 00010000:00010000:1.0:1790391396.584153:0:13284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962415e31200/0x35e94fc15449a74b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x35e94fc15449a752 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1790391396.584271:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a4b8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1790391396.584410:0:13284:0:(import.c:65:import_set_state_nolock()) ffff962410f6f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790391396.584414:0:13284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790391396.584417:0:13284:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790391396.584418:0:13284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790391396.584423:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790391396.584433:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff962439724380 x1877361130818560/t0(0) o250->MGC192.168.201.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790391403 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790391396.584491:0:13284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790391396.584494:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1790391396.587150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c86877e-0672-4feb-acd6-39a38006ba27:3306:1877361130818560:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1790391396.587333:0:13284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790391396.587344:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a3ee 00000020:00000080:1.0:1790391396.587352:0:13284:0:(genops.c:885:class_export_put()) final put ffff962411aaf000/2c86877e-0672-4feb-acd6-39a38006ba27 00000020:01000000:1.0:1790391396.587376:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.108@tcp (flags='') 00000020:00000080:1.0:1790391396.587382:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391396.587390:0:13284:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.108@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790391396.587394:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff962427f099c0) has no exports 00000020:00000080:2.0:1790391396.587443:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962411aaf000/2c86877e-0672-4feb-acd6-39a38006ba27 for MGC192.168.201.108@tcp 10000000:01000000:2.0:1790391396.587584:0:5833:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790391396.587714:0:13284:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.108@tcp: client import never connected 00000100:00080000:1.0:1790391396.587718:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790391396.587720:0:13284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790391396.587723:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790391396.587725:0:13284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790391396.587774:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391396.587781:0:13284:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.108@tcp (uuid 2c86877e-0672-4feb-acd6-39a38006ba27) 00000020:01000000:1.0:1790391396.587787:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790391396.587791:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391396.587794:0:13284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790391396.587799:0:13284:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff96243fa31000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790391396.587804:0:13284:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff96243fa299c0) has exports, disconnecting them 00000020:00080000:1.0:1790391396.587808:0:13284:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff96243fa31000), last request at 1790391195 00000020:00000080:1.0:1790391396.587812:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a625 00000020:00080000:1.0:1790391396.587838:0:13284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96243fa31000): rc 0 00000020:00000080:2.0:1790391396.587856:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962410f6f000 for MGC192.168.201.108@tcp 00000020:00000080:2.0:1790391396.587861:0:37:0:(genops.c:885:class_export_put()) final put ffff962411aad800/2c86877e-0672-4feb-acd6-39a38006ba27 00000020:00000080:2.0:1790391396.587864:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962411aad800/2c86877e-0672-4feb-acd6-39a38006ba27 for MGC192.168.201.108@tcp 00000020:01000000:2.0:1790391396.587868:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.108@tcp (2c86877e-0672-4feb-acd6-39a38006ba27) 00000020:00000080:1.0:1790391396.587940:0:13284:0:(genops.c:885:class_export_put()) final put ffff96243fa31000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790391396.588571:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96243fa31000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790391396.644110:0:13284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790391396.644120:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391396.644124:0:13284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790391396.644131:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391396.644417:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96243fa31800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1790391396.644436:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1790391396.644629:0:12978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1790391396.644763:0:12979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1790391396.644899:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1790391396.645108:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff962411376600:5819] 0 exiting: rc = 1 00000100:00100000:0.0:1790391396.647564:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff962411377a00:5820] 1 exiting: rc = 0 00000100:00100000:2.0:1790391396.647826:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.648321:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff962411376000:5823] 2 exiting: rc = 0 00000100:00100000:3.0:1790391396.648376:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff962411376800:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1790391396.648583:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff962411377200:5822] 1 exiting: rc = 0 00000100:00100000:2.0:1790391396.648635:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648642:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648648:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648655:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648660:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648666:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648672:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648677:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648683:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648688:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648694:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648711:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648718:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648724:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648732:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648739:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648746:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648753:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648758:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648764:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648783:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648788:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648794:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648799:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648804:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648809:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648815:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648819:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648824:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648829:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648834:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648839:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648844:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648850:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648855:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648860:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648865:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648869:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648874:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648879:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648884:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648889:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648894:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648900:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648906:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648911:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648916:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648922:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.648996:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649005:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649009:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649045:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649052:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649057:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649062:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649076:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649082:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649087:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649092:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649096:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649102:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649107:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649112:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.649124:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790391396.650509:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391396.650520:0:13284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790391396.650525:0:13284:0:(genops.c:885:class_export_put()) final put ffff96243a4ba800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790391396.650530:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a4ba800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790391396.650536:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1790391396.650574:0:13284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96243f8f8000 1 00000020:00000080:2.0:1790391396.650581:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x35e94fc15449a5ca 00000020:00000080:2.0:1790391396.650587:0:13284:0:(genops.c:885:class_export_put()) final put ffff96243a3a3800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1790391396.650604:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1790391396.650608:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391396.650613:0:13284:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790391396.650616:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff962427f40000) has no exports 00000020:00000080:3.0:1790391396.650679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96243a3a3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1790391396.667336:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391396.667353:0:13284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1790391396.667359:0:13284:0:(genops.c:885:class_export_put()) final put ffff96243f8fa800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1790391396.667364:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff96243f8fa800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1790391396.667375:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1790391396.667585:0:13284:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96243f8fc800 00000020:01000000:3.0:1790391396.667611:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1790391396.667615:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391396.667619:0:13284:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391396.667624:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff962427f0b380) has no exports 00000020:00000080:3.0:1790391396.667648:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391396.667654:0:13284:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1790391396.667657:0:13284:0:(genops.c:885:class_export_put()) final put ffff962439f9b000/OSS_uuid 00000020:00000080:3.0:1790391396.667659:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff962439f9b000/OSS_uuid for OSS 00000020:01000000:3.0:1790391396.667664:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1790391396.667760:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96243a3ab800:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1790391396.667865:0:12080:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff96243fe7d200:12080] 4 exiting: rc = 0 00000100:00100000:0.0:1790391396.669774:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff962411672c00:6697] 2 exiting: rc = 0 00000100:00080000:2.0:1790391396.670941:0:5832:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790391396.671068:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff962411672000:6695] 1 exiting: rc = 0 00000100:00100000:1.0:1790391396.671642:0:8917:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96243f6bac00:8917] 3 exiting: rc = 0 00000100:00100000:3.0:1790391396.673663:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.673672:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.673689:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.673706:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.673712:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.673717:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.673722:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.673726:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674833:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674841:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674847:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674853:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674859:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674865:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674871:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674876:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674882:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674888:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674894:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674899:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674905:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674911:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674916:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674922:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674928:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674934:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674940:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674945:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674951:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674956:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674962:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674967:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674972:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674977:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674983:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674988:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.674994:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675010:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675030:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675037:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675042:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675048:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675052:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675057:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675062:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675068:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675074:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675080:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675085:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675090:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675096:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675100:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675105:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675111:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675116:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675121:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675127:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675132:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675137:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675142:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675147:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675152:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675157:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391396.675163:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682378:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff962411376c00:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1790391396.682475:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96240912e000:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1790391396.682536:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682544:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682550:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682555:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682561:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682567:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682573:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682579:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682595:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682600:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682605:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682610:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682616:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682622:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682627:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682632:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682637:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682641:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682646:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682651:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682656:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682660:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682665:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682671:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682676:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682681:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682686:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682691:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682710:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682716:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682721:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682726:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682731:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682735:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682740:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682745:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682750:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682754:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682760:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682765:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682770:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682775:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682780:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682794:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682801:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682806:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682812:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682818:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682822:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682827:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682834:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682840:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682845:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682850:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682856:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682861:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682867:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682872:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682877:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682883:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682888:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682893:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682898:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.682903:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.683638:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff962411bec000:6700] 0 exiting: rc = 1 00000100:00100000:0.0:1790391396.685273:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff962410f86400:6702] 2 exiting: rc = 0 00000100:00100000:2.0:1790391396.685427:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff962411bede00:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1790391396.685516:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685526:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685536:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685546:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685554:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685561:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685575:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685584:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685594:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685601:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685615:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685622:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685639:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685645:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685652:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685659:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685666:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685671:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685677:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685681:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685686:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685690:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685721:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685729:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685735:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685740:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685746:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685751:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685757:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685762:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685768:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685774:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685780:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685786:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685792:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685798:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685804:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685810:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685816:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685823:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685829:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685836:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685842:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685847:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685853:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685859:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685879:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685893:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685899:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685905:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685912:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685918:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685924:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.685992:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686001:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686006:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686011:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686047:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686061:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686073:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686080:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686085:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686091:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.686096:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391396.693808:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96240ead9400:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1790391396.693916:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9624125a8600:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1790391396.694060:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694068:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694075:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694082:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694088:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694095:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694104:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694115:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694121:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694139:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694146:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694166:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694171:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694176:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694181:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694186:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694191:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694195:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694214:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694219:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694223:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694228:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694234:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694239:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694245:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694249:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694254:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694259:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694263:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694268:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694274:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694279:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694284:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694290:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694296:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694301:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694306:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694310:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694315:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694320:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694326:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694331:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694336:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694341:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694346:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694351:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694356:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694361:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694366:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694371:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694377:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694381:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694386:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694398:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694403:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694409:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694414:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694419:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694425:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694429:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694435:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694440:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694445:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.694456:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.705882:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96240ead9e00:6706] 1 exiting: rc = 0 00000100:00100000:2.0:1790391396.705989:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96240ead8800:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1790391396.707956:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.707963:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.707985:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.707992:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.707996:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708002:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708010:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708055:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708062:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708068:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708075:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708099:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708107:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708112:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708119:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708124:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708130:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708135:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708163:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708173:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708190:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708198:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708220:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708240:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708245:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708249:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708253:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708256:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708260:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708272:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708275:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708279:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708282:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708286:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708289:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708302:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708307:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708311:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708315:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708319:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708323:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708327:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708331:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708335:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708338:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708342:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708346:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708358:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708362:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708366:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708370:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708378:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708381:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708385:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708394:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708398:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708402:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708410:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708414:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708427:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708431:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708435:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708439:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391396.708456:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1790391396.739562:0:13284:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790391416.577903:0:13900:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790391428.159761:0:14372:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790391428.159768:0:14372:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1790391428.160212:0:14372:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962411e7e800 00000020:01000004:3.0:1790391428.160227:0:14372:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790391428.160235:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790391428.160249:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96241ffb99c0) 00000020:00000080:3.0:1790391428.160263:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790391428.175929:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790391428.178109:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790391428.178554:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1790391428.178699:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1790391428.178785:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1790391428.178963:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790391428.179062:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1790391428.179156:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1790391428.179448:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1790391428.179682:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1790391428.180790:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 587: rc = 0 00100000:10000000:2.0:1790391428.180876:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 587: rc = 0 00100000:10000000:2.0:1790391428.181617:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1790391428.181855:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 592: rc = 0 00100000:10000000:2.0:1790391428.182126:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 592: rc = 0 00100000:10000000:2.0:1790391428.182440:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 592: rc = 0 00100000:10000000:2.0:1790391428.182673:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1790391428.182910:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1790391428.183280:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1790391428.183837:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 592: rc = 0 00100000:10000000:0.0:1790391428.184635:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00100000:10000000:0.0:1790391428.184900:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00100000:10000000:0.0:1790391428.185409:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00100000:10000000:0.0:1790391428.185675:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 592: rc = 0 00100000:10000000:0.0:1790391428.186107:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 665: rc = 0 00100000:10000000:0.0:1790391428.186523:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 665: rc = 0 00100000:10000000:0.0:1790391428.186757:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 665: rc = 0 00100000:10000000:0.0:1790391428.187192:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 665: rc = 0 00100000:10000000:0.0:1790391428.187526:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 665: rc = 0 00100000:10000000:0.0:1790391428.187776:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 665: rc = 0 00100000:10000000:0.0:1790391428.188008:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 665: rc = 0 00100000:10000000:0.0:1790391428.188515:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 665: rc = 0 00100000:10000000:0.0:1790391428.188763:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 665: rc = 0 00100000:10000000:0.0:1790391428.188976:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 665: rc = 0 00100000:10000000:0.0:1790391428.189302:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 665: rc = 0 00100000:10000000:0.0:1790391428.189608:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 665: rc = 0 00100000:10000000:0.0:1790391428.189841:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 665: rc = 0 00100000:10000000:0.0:1790391428.190157:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 665: rc = 0 00100000:10000000:0.0:1790391428.190472:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 665: rc = 0 00100000:10000000:0.0:1790391428.190715:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 665: rc = 0 00100000:10000000:0.0:1790391428.190940:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 665: rc = 0 00100000:10000000:0.0:1790391428.191225:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 665: rc = 0 00100000:10000000:0.0:1790391428.191528:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 665: rc = 0 00100000:10000000:0.0:1790391428.191762:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 665: rc = 0 00100000:10000000:0.0:1790391428.191986:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 665: rc = 0 00100000:10000000:0.0:1790391428.192406:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 665: rc = 0 00100000:10000000:0.0:1790391428.192733:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 665: rc = 0 00100000:10000000:0.0:1790391428.192982:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 665: rc = 0 00100000:10000000:0.0:1790391428.193265:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 665: rc = 0 00100000:10000000:0.0:1790391428.193537:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 665: rc = 0 00100000:10000000:0.0:1790391428.193779:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 665: rc = 0 00100000:10000000:0.0:1790391428.194069:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 665: rc = 0 00100000:10000000:0.0:1790391428.194333:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 665: rc = 0 00100000:10000000:0.0:1790391428.194560:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 665: rc = 0 00100000:10000000:0.0:1790391428.194801:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 665: rc = 0 00100000:10000000:0.0:1790391428.195095:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 665: rc = 0 00100000:10000000:0.0:1790391428.195663:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 116: rc = 0 00100000:10000000:0.0:1790391428.196207:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1790391428.196713:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 292: rc = 0 00100000:10000000:0.0:1790391428.196890:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1790391428.196947:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 292: rc = 0 00100000:10000000:0.0:1790391428.197135:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1790391428.197211:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 292: rc = 0 00100000:10000000:0.0:1790391428.197617:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1790391428.197685:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 588: rc = 0 00100000:10000000:0.0:1790391428.197871:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1790391428.197937:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 588: rc = 0 00100000:10000000:0.0:1790391428.198146:0:14372:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1790391428.198539:0:14372:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 588: rc = 0 00000020:00000080:0.0:1790391428.198783:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790391428.198792:0:14372:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790391428.198803:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449b6ef 00000020:01000004:0.0:1790391428.198812:0:14372:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1790391428.198817:0:14372:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790391428.198822:0:14372:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962411e7e800 from MGS 00000020:01000004:0.0:1790391428.198826:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790391428.198837:0:14372:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96243fa2cd40) 00000020:00000080:0.0:1790391428.198845:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790391428.198897:0:14372:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962411e7e800 from MGS, refs=2 00080000:01000000:0.0:1790391428.198902:0:14372:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790391428.198906:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449b6fd 00000100:00100000:0.0:1790391428.198994:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790391428.199240:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790391428.199247:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790391428.199763:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790391428.199770:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790391428.200509:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391428.200657:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790391428.200664:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790391428.201188:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790391428.201194:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790391428.201554:0:14372:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790391428.201560:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790391428.202203:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391428.202206:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391428.202214:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391428.202539:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391428.202541:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391428.202543:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391428.203035:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790391428.207508:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790391428.214917:0:14372:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1790391428.214936:0:14372:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790391428.214939:0:14372:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1790391428.216719:0:14381:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790391428.216857:0:14372:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790391428.216951:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790391428.217512:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790391428.218061:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391428.218230:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790391428.218236:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790391428.224721:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790391428.224736:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790391428.225294:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790391428.225301:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790391428.226544:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790391428.226568:0:14372:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.108@tcp' 00000020:01000004:1.0:1790391428.226570:0:14372:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790391428.226601:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.108@tcp (typ=mgc) 00000020:00000080:1.0:1790391428.226612:0:14372:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.108@tcp (ffff96243a7f99c0) 00000020:00000080:1.0:1790391428.226626:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790391428.226700:0:14372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96243a18e800@MGC192.168.201.108@tcp: add connection 192.168.201.108@tcp at head 00010000:00010000:1.0:1790391428.226855:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.108@tcp-0 is initialized 00000040:01000000:1.0:1790391428.226862:0:14372:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790391428.227211:0:14386:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790391428.229638:0:14387:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790391428.233477:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.108@tcp (uuid bbc90112-ffb7-4b19-a960-3ef7f783602e) 00000020:00000080:1.0:1790391428.233519:0:14372:0:(genops.c:1385:class_connect()) connect: client bbc90112-ffb7-4b19-a960-3ef7f783602e, cookie 0x35e94fc15449b70b 00000100:00080000:1.0:1790391428.233532:0:14372:0:(import.c:545:import_select_connection()) MGC192.168.201.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391428.233538:0:14372:0:(import.c:665:import_select_connection()) MGC192.168.201.108@tcp: import ffff96243a18e800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1790391428.233574:0:14372:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962302089180 x1877361130818816/t0(0) o250->MGC192.168.201.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391428.233600:0:14372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bbc90112-ffb7-4b19-a960-3ef7f783602e->MGS 00000020:01000004:1.0:1790391428.233621:0:14372:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790391428.233626:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790391428.233639:0:14372:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff96243a7fb380) 00000020:00000080:1.0:1790391428.233651:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790391428.234268:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bbc90112-ffb7-4b19-a960-3ef7f783602e:3306:1877361130818816:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790391428.236578:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.236704:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130818816 00000100:00100000:0.0:1790391428.236713:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130818816 00000100:00100000:0.0:1790391428.236764:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391428.236773:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1877361130818816:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790391428.236799:0:14382:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bbc90112-ffb7-4b19-a960-3ef7f783602e@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1790391428.236829:0:14382:0:(genops.c:1385:class_connect()) connect: client bbc90112-ffb7-4b19-a960-3ef7f783602e, cookie 0x35e94fc15449b719 00000100:00080000:0.0:1790391428.236951:0:14382:0:(import.c:65:import_set_state_nolock()) ffff962440df4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391428.237005:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+5:3306:x1877361130818816:12345-0@lo:250:mount.lustre.0 Request processed in 232us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.237044:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391428.237344:0:3306:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790391428.237353:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.108@tcp: connect to target with instance 0 00000100:00080000:3.0:1790391428.237360:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790391428.237364:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790391428.237367:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96243a18e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790391428.237370:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790391428.237377:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790391428.237381:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bbc90112-ffb7-4b19-a960-3ef7f783602e:3306:1877361130818816:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790391428.248833:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391428.249189:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790391428.249196:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790391428.252201:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790391428.252213:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790391428.252592:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790391428.252598:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790391428.253237:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391428.253491:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790391428.253496:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790391428.253969:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790391428.253975:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790391428.285639:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391428.285868:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790391428.285874:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790391428.291242:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790391428.291257:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790391428.292676:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391428.293632:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790391428.293640:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790391428.294442:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391428.294452:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790391428.294962:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391428.295195:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790391428.295201:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790391428.295874:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790391428.295880:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790391428.296506:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391428.296652:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790391428.296657:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790391428.297238:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790391428.297246:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790391428.313889:0:14372:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391428.314326:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790391428.314333:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790391428.315871:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790391428.315883:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790391428.317193:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790391428.317206:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790391428.317946:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790391428.317970:0:14372:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1790391428.318127:0:14372:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790391428.318259:0:14372:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790391428.318293:0:14372:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790391428.318297:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790391428.318299:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391428.318304:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391428.318305:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391428.318306:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391428.318307:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391428.318308:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391428.318309:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391428.318310:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391428.318311:0:14372:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391428.318314:0:14372:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790391428.318316:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391428.318316:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391428.318318:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391428.318318:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391428.318319:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391428.318320:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391428.318321:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391428.318322:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391428.318323:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391428.318324:0:14372:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391428.318351:0:14372:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790391428.318373:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130818944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790391428.318446:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.318539:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a17fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.318739:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130818944 00000100:00100000:2.0:1790391428.318746:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130818944 00000100:00100000:2.0:1790391428.318878:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391428.318889:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+5:14372:x1877361130818944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790391428.318931:0:14385:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790391428.318934:0:14385:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790391428.318936:0:14385:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790391428.319286:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790391428.319606:0:14385:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1790391428.321424:0:14407:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790391428.321431:0:14407:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790391428.321434:0:14407:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790391428.321524:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790391428.322265:0:14385:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790391428.322277:0:14385:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790391428.334492:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+5:14372:x1877361130818944:12345-0@lo:253:mount.lustre.0 Request processed in 15596us (16036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.334507:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391428.334652:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130818944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790391428.334671:0:14372:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790391428.334675:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391428.334677:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391428.334678:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391428.334679:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391428.334681:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391428.334682:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391428.334684:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391428.334699:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391428.334701:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391428.334702:0:14372:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790391428.334722:0:14372:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962411e7e800 from lustre-MDT0000 10000000:01000000:1.0:1790391428.334750:0:14372:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790391428.334752:0:14372:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790391428.334757:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96243a7f99c0 10000000:01000000:1.0:1790391428.334761:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391428.334768:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96243a7f99c0 from 1 10000000:01000000:1.0:1790391428.334771:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391428.334810:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.334821:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.334830:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391428.334849:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391428.334881:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.334914:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391428.335006:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130819072 00000100:00100000:3.0:1790391428.335037:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130819072 00000100:00100000:3.0:1790391428.335125:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391428.335134:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+5:14372:x1877361130819072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391428.335145:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391428.335159:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2a00/0x35e94fc15449b727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b720 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.335192:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2a00/0x35e94fc15449b727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b720 expref: 6 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.335202:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2a00/0x35e94fc15449b727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b720 expref: 6 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.335210:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2a00, rc 0) 00000100:00100000:3.0:1790391428.335293:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+6:14372:x1877361130819072:12345-0@lo:101:mount.lustre.0 Request processed in 160us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391428.335300:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391428.337217:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391428.337243:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.337255:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391428.337332:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391428.337404:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391428.337489:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241f1e9300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391428.339211:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130819200 00000100:00100000:3.0:1790391428.339224:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130819200 00000100:00100000:3.0:1790391428.339286:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391428.339295:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+6:14372:x1877361130819200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391428.339858:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+6:14372:x1877361130819200:12345-0@lo:501:mount.lustre.0 Request processed in 561us (2451us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391428.339867:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391428.347346:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819200:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790391428.347410:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790391428.347435:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.347447:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391428.347456:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962411e7e800 10000000:01000000:2.0:1790391428.347461:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790391428.347467:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff962411e7e800 10000000:01000000:2.0:1790391428.347469:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790391428.347473:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff962411e7e800 from 1 10000000:01000000:2.0:1790391428.347475:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790391428.347510:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412f10600/0x35e94fc15449b72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.347519:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412f10600/0x35e94fc15449b72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.347529:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412f10600/0x35e94fc15449b72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391428.347550:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391428.347611:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391428.347787:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241f1e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391428.347842:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130819328 00000100:00100000:1.0:1790391428.347849:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130819328 00000100:00100000:0.0:1790391428.353586:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391428.353603:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+6:14372:x1877361130819328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391428.353620:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391428.353643:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e979e00/0x35e94fc15449b735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b72e expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.353675:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e979e00/0x35e94fc15449b735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b72e expref: 7 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.353703:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e979e00/0x35e94fc15449b735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b72e expref: 7 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.353711:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979e00, rc 0) 00000100:00100000:0.0:1790391428.353797:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+7:14372:x1877361130819328:12345-0@lo:101:mount.lustre.0 Request processed in 197us (6185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.353804:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391428.353941:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391428.353961:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412f10600/0x35e94fc15449b72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b735 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.353993:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412f10600/0x35e94fc15449b72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b735 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391428.354041:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790391428.354052:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412f10600/0x35e94fc15449b72e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b735 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.354059:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412f10600/0x35e94fc15449b72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b735 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391428.354067:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790391428.354072:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391428.354077:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff962411e7e800 10000000:01000000:3.0:1790391428.354080:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790391428.354083:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790391428.354085:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790391428.354112:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e2600/0x35e94fc15449b73c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.354120:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96243a2e2600/0x35e94fc15449b73c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.354128:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96243a2e2600/0x35e94fc15449b73c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391428.354148:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391428.354193:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.354221:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391428.354365:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130819456 00000100:00100000:0.0:1790391428.354372:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130819456 00000100:00100000:0.0:1790391428.354406:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391428.354414:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+7:14372:x1877361130819456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391428.354422:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391428.354431:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e978600/0x35e94fc15449b743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b73c expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.354445:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e978600/0x35e94fc15449b743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b73c expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.354454:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e978600/0x35e94fc15449b743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b73c expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.354461:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978600, rc 0) 00000100:00100000:0.0:1790391428.354487:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+8:14372:x1877361130819456:12345-0@lo:101:mount.lustre.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.354493:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391428.354567:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391428.354577:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96243a2e2600/0x35e94fc15449b73c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b743 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.354585:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96243a2e2600/0x35e94fc15449b73c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b743 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391428.354630:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391428.354656:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.354680:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391428.354728:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130819584 00000100:00100000:0.0:1790391428.354732:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130819584 00000100:00100000:0.0:1790391428.354766:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391428.354772:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+8:14372:x1877361130819584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391428.355194:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14372:x1877361130819584:12345-0@lo:501:mount.lustre.0 Request processed in 421us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.355201:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391428.355364:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391428.355395:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391428.355434:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.355453:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.355696:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130819712 00000100:00100000:2.0:1790391428.355703:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130819712 00000100:00100000:2.0:1790391428.355742:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391428.355750:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14372:x1877361130819712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391428.356211:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14372:x1877361130819712:12345-0@lo:503:mount.lustre.0 Request processed in 460us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.356219:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391428.356304:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130819712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391428.358871:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14408:1877361130819840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391428.358945:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.358995:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391428.359112:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130819840 00000100:00100000:0.0:1790391428.359119:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130819840 00000100:00100000:0.0:1790391428.359168:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391428.359187:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14408:x1877361130819840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391428.359554:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14408:x1877361130819840:12345-0@lo:502:llog_process_th.0 Request processed in 377us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.359563:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790391428.359749:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14408:1877361130819840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391428.359781:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391428.359793:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391428.359796:0:14408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790391428.359802:0:14408:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790391428.359805:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391428.359823:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96241ffb8000) 00000020:00000080:3.0:1790391428.359847:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790391428.359862:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790391428.359931:0:14408:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790391428.359943:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449b751 00000020:00000080:3.0:1790391428.360271:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790391428.360276:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391428.360280:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391428.360281:0:14408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790391428.360284:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391428.360288:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391428.360289:0:14408:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790391428.360292:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391428.360300:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96241ffbb380) 00000020:00000080:3.0:1790391428.360309:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790391428.360314:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790391428.360316:0:14408:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790391428.360318:0:14408:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790391428.360324:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790391428.360365:0:14408:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962411e7e800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790391428.360378:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96241ffbcd40) 00000020:00000080:3.0:1790391428.360387:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790391428.360429:0:14408:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790391428.360435:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449b766 00000020:00000080:3.0:1790391428.360704:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790391428.360711:0:14408:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790391428.360715:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x35e94fc15449b76d 00080000:01000000:3.0:1790391428.360721:0:14408:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790391428.360724:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449b774 00010000:00010000:2.0:1790391428.458873:0:14408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790391428.460501:0:14408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1790391428.460690:0:14408:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790391428.461695:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff962427f099c0) 00000020:00000080:2.0:1790391428.461719:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790391428.461814:0:14408:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790391428.461824:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449b782 00000020:00000080:3.0:1790391428.466285:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790391428.471533:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x35e94fc15449b789 00000020:00000080:1.0:1790391428.475475:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790391428.475491:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391428.475503:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.475506:0:14408:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790391428.475510:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391428.475517:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.475518:0:14408:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790391428.475534:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790391428.475589:0:14408:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790391428.475616:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391428.475619:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.475621:0:14408:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790391428.475623:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790391428.475625:0:14408:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1790391428.475627:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790391428.475629:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790391428.475630:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790391428.475633:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.475634:0:14408:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790391428.475636:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790391428.475641:0:14408:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790391428.475645:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.475646:0:14408:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790391428.475649:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790391428.475655:0:14408:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:1.0:1790391428.475683:0:14408:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790391428.475687:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391428.475705:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96243a7f8000) 00000020:00000080:1.0:1790391428.475722:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790391428.475728:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790391428.475798:0:14408:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790391428.475803:0:14408:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790391428.475810:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449b797 00010000:00080000:1.0:1790391428.475842:0:14408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962402cbf000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:1.0:1790391428.476373:0:14408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1790391428.476790:0:14408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790391428.476837:0:14408:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790391428.481602:0:14408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391428.481668:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790391428.481749:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790391428.482956:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790391428.482964:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790391428.484390:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391428.484408:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790391428.484449:0:14408:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790391428.484477:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449b79e 00000100:00080000:2.0:1790391428.484488:0:14408:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391428.484494:0:14408:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962402cbf000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391428.484533:0:14408:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439727480 x1877361130819968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391428.484602:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130819968:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790391428.484676:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361130819968 offset 0 length 520: 4 00000100:00080000:2.0:1790391428.484743:0:14408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790391428.484834:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391428.484838:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391428.484840:0:14408:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790391428.484843:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790391428.484846:0:14408:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1790391428.484848:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391428.484849:0:14408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391428.484851:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790391428.484859:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391428.484860:0:14408:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790391428.484863:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391428.484868:0:14408:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790391428.484871:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391428.484873:0:14408:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790391428.484876:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790391428.484879:0:14408:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.108@tcp to nid 0x20000c0a8c96c (192.168.201.108@tcp) 00000020:01000000:2.0:1790391428.484901:0:14408:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790391428.484903:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391428.484917:0:14408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff962427f08000) 00000020:00000080:2.0:1790391428.484930:0:14408:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790391428.484935:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790391428.485001:0:14408:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790391428.485008:0:14408:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790391428.485262:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x35e94fc15449b7ac 00010000:00080000:2.0:1790391428.485296:0:14408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962407ac7800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1790391428.485513:0:14408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1790391428.485722:0:14408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790391428.485747:0:14408:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790391428.487301:0:14408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391428.487385:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790391428.487449:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1790391428.490766:0:14414:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790391428.490774:0:14414:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790391428.491862:0:14408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391428.491874:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790391428.491907:0:14408:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790391428.491928:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449b7b3 00000100:00080000:1.0:1790391428.491940:0:14408:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391428.491947:0:14408:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962407ac7800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1790391428.492258:0:14408:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96230208b480 x1877361130820096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391428.492321:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130820096:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790391428.492381:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361130820096 offset 0 length 520: 4 00000100:00080000:1.0:1790391428.492451:0:14408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790391428.492511:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391428.492516:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.492517:0:14408:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790391428.492520:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391428.492524:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.492525:0:14408:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391428.492527:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391428.492529:0:14408:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790391428.492532:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391428.492534:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.492535:0:14408:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790391428.492538:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391428.492540:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.492541:0:14408:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790391428.492544:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790391428.492574:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14408:1877361130820224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391428.492624:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.492641:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff96243a2f8300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391428.492755:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130820224 00000100:00100000:0.0:1790391428.492764:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130820224 00000100:00100000:0.0:1790391428.492816:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391428.492827:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14408:x1877361130820224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391428.493247:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14408:x1877361130820224:12345-0@lo:502:llog_process_th.0 Request processed in 420us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.493256:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391428.493493:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14408:1877361130820224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391428.493520:0:14408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391428.493530:0:14408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.493531:0:14408:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790391428.493535:0:14408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790391428.493705:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1790391428.493725:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790391428.493748:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e2600/0x35e94fc15449b73c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b743 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.493758:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96243a2e2600/0x35e94fc15449b73c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b743 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391428.493776:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962411e7e800 from 1 10000000:01000000:0.0:1790391428.493779:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391428.493808:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.493815:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.493825:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391428.493842:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391428.493878:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.494349:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.494658:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130820352 00000100:00100000:2.0:1790391428.494666:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130820352 00000100:00100000:2.0:1790391428.494738:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391428.494747:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+9:14372:x1877361130820352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391428.494758:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391428.494774:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b7ba expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.494806:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 10 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.494816:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 10 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.494824:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10a00, rc 0) 00000100:00100000:2.0:1790391428.494870:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+10:14372:x1877361130820352:12345-0@lo:101:mount.lustre.0 Request processed in 125us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.494877:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391428.494942:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391428.494956:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.494964:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391428.495506:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820480:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790391428.495549:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.495951:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391428.496102:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130820480 00000100:00100000:0.0:1790391428.496109:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130820480 00000100:00100000:0.0:1790391428.496140:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391428.496148:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+10:14372:x1877361130820480:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790391428.496164:0:14382:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790391428.496169:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790391428.496258:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+10:14372:x1877361130820480:12345-0@lo:256:mount.lustre.0 Request processed in 110us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.496264:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391428.496459:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820480:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790391428.497204:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391428.497220:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.497232:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391428.497241:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962411e7e800 from 1 10000000:01000000:3.0:1790391428.497243:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391428.497276:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.497284:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.497294:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391428.497364:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391428.497411:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.497456:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.497593:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130820608 00000100:00100000:2.0:1790391428.497601:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130820608 00000100:00100000:2.0:1790391428.497647:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391428.497656:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+10:14372:x1877361130820608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391428.497667:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391428.497680:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b7c8 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.497704:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.497716:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.497725:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10200, rc 0) 00000100:00100000:2.0:1790391428.497768:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14372:x1877361130820608:12345-0@lo:101:mount.lustre.0 Request processed in 114us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.497775:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391428.497876:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391428.497888:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.497906:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391428.497960:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391428.497996:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.498045:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.498160:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130820736 00000100:00100000:2.0:1790391428.498164:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130820736 00000100:00100000:2.0:1790391428.498196:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391428.498202:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14372:x1877361130820736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391428.498565:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14372:x1877361130820736:12345-0@lo:501:mount.lustre.0 Request processed in 362us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.498574:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391428.498703:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391428.498732:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391428.498770:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.498790:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.498844:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130820864 00000100:00100000:2.0:1790391428.498848:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130820864 00000100:00100000:2.0:1790391428.498877:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391428.498884:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14372:x1877361130820864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391428.499164:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14372:x1877361130820864:12345-0@lo:503:mount.lustre.0 Request processed in 280us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.499181:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391428.499256:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130820864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391428.499621:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14416:1877361130820992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391428.499656:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391428.499686:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624304bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391428.499737:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130820992 00000100:00100000:3.0:1790391428.499742:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130820992 00000100:00100000:3.0:1790391428.499776:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391428.499784:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14416:x1877361130820992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391428.500081:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14416:x1877361130820992:12345-0@lo:502:llog_process_th.0 Request processed in 190us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391428.500087:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391428.500261:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14416:1877361130820992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391428.500285:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391428.500294:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391428.500296:0:14416:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790391428.500302:0:14416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962411e7e800 00000020:00000080:0.0:1790391428.500304:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391428.500313:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391428.500316:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391428.500317:0:14416:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790391428.500319:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391428.500322:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391428.500323:0:14416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790391428.500327:0:14416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962411e7e800 00000020:00000080:0.0:1790391428.500328:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391428.500434:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391428.500445:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391428.500446:0:14416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790391428.500450:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391428.500452:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391428.500454:0:14416:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391428.500457:0:14416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962411e7e800 00000020:00000080:0.0:1790391428.500460:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391428.501200:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14416:1877361130821120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391428.501255:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.501280:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff962416ddea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.501338:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130821120 00000100:00100000:2.0:1790391428.501344:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130821120 00000100:00100000:2.0:1790391428.501385:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790391428.501395:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14416:x1877361130821120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391428.501619:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14416:x1877361130821120:12345-0@lo:502:llog_process_th.0 Request processed in 225us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.501627:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391428.503167:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14416:1877361130821120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391428.503219:0:14416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391428.503227:0:14416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391428.503229:0:14416:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790391428.503233:0:14416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790391428.503392:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790391428.503410:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391428.503432:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.503442:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391428.503486:0:14372:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790391428.503489:0:14372:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962411e7e800 10000000:01000000:0.0:1790391428.503492:0:14372:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962411e7e800 10000000:01000000:0.0:1790391428.503496:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391428.503501:0:14372:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962411e7e800 from 1 10000000:01000000:0.0:1790391428.503504:0:14372:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790391428.503535:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978e00/0x35e94fc15449b7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.503544:0:14372:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e978e00/0x35e94fc15449b7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.503555:0:14372:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e978e00/0x35e94fc15449b7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391428.503581:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130821248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391428.503632:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.503665:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624153c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391428.506856:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130821248 00000100:00100000:1.0:1790391428.506871:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130821248 00000100:00100000:1.0:1790391428.506923:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391428.506932:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14372:x1877361130821248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391428.506947:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391428.506966:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e960400/0x35e94fc15449b7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b7d6 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.506992:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e960400/0x35e94fc15449b7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b7d6 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.507003:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e960400/0x35e94fc15449b7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b7d6 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.507031:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e960400, rc 0) 00000100:00100000:1.0:1790391428.507100:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14372:x1877361130821248:12345-0@lo:101:mount.lustre.0 Request processed in 168us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.507107:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391428.507224:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130821248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391428.507243:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e978e00/0x35e94fc15449b7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7dd expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.507253:0:14372:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e978e00/0x35e94fc15449b7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b7dd expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391428.507325:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130821376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391428.507359:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.507395:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624153c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391428.511862:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130821376 00000100:00100000:1.0:1790391428.511880:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130821376 00000100:00100000:1.0:1790391428.511951:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391428.511962:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14372:x1877361130821376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391428.512312:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14372:x1877361130821376:12345-0@lo:501:mount.lustre.0 Request processed in 351us (4952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.512320:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391428.518196:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130821376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391428.518265:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130821504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391428.518338:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.518387:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624153c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.518449:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130821504 00000100:00100000:2.0:1790391428.518457:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130821504 00000100:00100000:2.0:1790391428.518517:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391428.518534:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14372:x1877361130821504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391428.518726:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14372:x1877361130821504:12345-0@lo:503:mount.lustre.0 Request processed in 194us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.518734:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391428.518818:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130821504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391428.519271:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14421:1877361130821632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391428.519311:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391428.519337:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130821632 00000100:00100000:2.0:1790391428.519341:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130821632 00000100:00100000:2.0:1790391428.519366:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391428.519372:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14421:x1877361130821632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391428.519537:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14421:x1877361130821632:12345-0@lo:502:llog_process_th.0 Request processed in 164us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.519544:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391428.519581:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624304bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391428.519594:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14421:1877361130821632:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790391428.519646:0:14421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790391428.519661:0:14421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff962427f0b380) 00000020:00000080:2.0:1790391428.519681:0:14421:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790391428.519757:0:14421:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962411e7e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790391428.519761:0:14421:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962411e7e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790391428.519764:0:14421:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962411e7e800 4 00010000:00080000:2.0:1790391428.519803:0:14421:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962427e80800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1790391428.522773:0:14421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790391428.523065:0:14421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790391428.523106:0:14421:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391428.523118:0:14421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x35e94fc15449b7eb 00000100:00080000:2.0:1790391428.523129:0:14421:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391428.523142:0:14421:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff962427e80800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391428.523198:0:14421:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439726d80 x1877361130821760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391428.523225:0:14421:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790391428.525342:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130821760:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391428.525425:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.525563:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130821760 00000100:00100000:3.0:1790391428.525573:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130821760 00000100:00100000:3.0:1790391428.525616:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391428.525625:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1877361130821760:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790391428.525686:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1877361130821760:12345-0@lo:38:llog_process_th.0 Request processed in 60us (260us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790391428.525695:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391428.525735:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391428.525745:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962427e80800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391428.525750:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790391428.525753:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130821760:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790391428.531558:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14421:1877361130821888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391428.531647:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391428.531684:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624304bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391428.533508:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130821888 00000100:00100000:0.0:1790391428.533522:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130821888 00000100:00100000:0.0:1790391428.533588:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391428.533598:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14421:x1877361130821888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391428.533940:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14421:x1877361130821888:12345-0@lo:502:llog_process_th.0 Request processed in 343us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.533958:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790391428.534535:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bbc90112-ffb7-4b19-a960-3ef7f783602e:14421:1877361130821888:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790391428.534572:0:14421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790391428.534687:0:14372:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790391428.534705:0:14372:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391428.534763:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978e00/0x35e94fc15449b7d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7dd expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391428.534775:0:14372:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e978e00/0x35e94fc15449b7d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b7dd expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790391428.534817:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790391428.534819:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391428.534820:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391428.534822:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391428.534823:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391428.534824:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391428.534825:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391428.534827:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391428.534829:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391428.534830:0:14372:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391428.534835:0:14372:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790391428.534837:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391428.534838:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391428.534839:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391428.534841:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391428.534842:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391428.534843:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391428.534844:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391428.534845:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391428.534845:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391428.534846:0:14372:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391428.534868:0:14372:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790391428.534885:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130822016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391428.534925:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.534959:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391428.535254:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822016 00000100:00100000:3.0:1790391428.535266:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822016 00000100:00100000:3.0:1790391428.535307:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790391428.535315:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14372:x1877361130822016:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790391428.535350:0:14385:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790391428.535365:0:14385:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790391428.642604:0:14385:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790391428.642626:0:14385:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790391428.642726:0:14406:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790391428.642731:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790391428.642756:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.642782:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.642791:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.642829:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391428.642950:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 12 pid: 14385 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391428.642965:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1877361130822144:0@lo:104: 00000100:00100000:3.0:1790391428.643051:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.643117:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391428.643666:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822144 00000100:00100000:1.0:1790391428.643674:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822144 00000100:00100000:1.0:1790391428.643728:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391428.643738:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14406:x1877361130822144:12345-0@lo:104: 00010000:00010000:1.0:1790391428.643753:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.644587:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391428.644596:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14406:x1877361130822144:12345-0@lo:104: Request processed in 859us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.644605:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790391428.644632:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391428.644638:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.644646:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979c00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391428.644651:0:14379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.644659:0:14379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391428.644681:0:14379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391428.644686:0:14379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391428.644721:0:14379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.644728:0:14379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391428.644748:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.644756:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96240e979c00/0x35e94fc15449b7ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b7c1 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.644901:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391428.644904:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391428.644905:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391428.644944:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130822272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391428.644984:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.645082:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822272 00000100:00100000:1.0:1790391428.645088:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822272 00010000:00010000:1.0:1790391428.645110:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 13 pid: 14385 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391428.646581:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391428.646597:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+13:3308:x1877361130822272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391428.646614:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391428.646621:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 13 pid: 14385 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646648:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 13 pid: 14385 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646669:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646677:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790391428.646693:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003962124s 00010000:00010000:1.0:1790391428.646697:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646704:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646711:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646719:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646725:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391428.646729:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646737:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646746:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391428.646763:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391428.647032:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+13:3308:x1877361130822272:12345-0@lo:103:ldlm_bl.0 Request processed in 421us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.647040:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391428.648115:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130822272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391428.653844:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412f10a00/0x35e94fc15449b7c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449b7ba expref: 12 pid: 14385 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391428.653871:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1877361130822144:0@lo:104: 00010000:00010000:0.0:1790391428.653899:0:14406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.654080:0:14406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.654089:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391428.654096:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b7f2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391428.671702:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14372:x1877361130822016:12345-0@lo:253:mount.lustre.0 Request processed in 136378us (136766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.671716:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391428.671819:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:14372:1877361130822016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391428.671907:0:14372:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790391428.671911:0:14372:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391428.671913:0:14372:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391428.671914:0:14372:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391428.671915:0:14372:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391428.671917:0:14372:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391428.671918:0:14372:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391428.671919:0:14372:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391428.671921:0:14372:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391428.671922:0:14372:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391428.671924:0:14372:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790391428.671939:0:14372:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790391428.679295:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391428.679546:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391428.683729:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391428.684112:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391428.685068:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391428.685470:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391428.686921:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391428.687303:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391428.687601:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391428.687922:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790391428.688313:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790391428.688543:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1790391428.719253:0:14372:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1790391428.719593:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790391428.719690:0:14428:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1790391428.719694:0:14428:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1790391428.719794:0:14429:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1790391428.721049:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1790391428.723544:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790391428.723674:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790391428.724961:0:14372:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790391428.724974:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790391428.725166:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391428.729306:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790391428.732355:0:14429:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790391428.732522:0:14429:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1790391428.733671:0:14372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790391428.738244:0:14372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790391428.738328:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1790391428.746861:0:14372:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1790391428.752789:0:14372:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790391428.805860:0:14372:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790391428.805899:0:14372:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe8c18a7988 00100000:10000000:1.0:1790391428.805907:0:14372:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790391428.806948:0:14372:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790391428.806965:0:14372:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790391428.806979:0:14372:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790391428.807005:0:14372:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1790391429.209330:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391429.593672:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1790391429.663307:0:14387:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790391429.663316:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962411e7e800 from 6 10000000:01000000:3.0:1790391429.663321:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391429.663373:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391429.663398:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391429.663410:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391429.663436:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130822400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391429.663505:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391429.663562:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391429.664128:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822400 00000100:00100000:0.0:1790391429.664148:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822400 00000100:00100000:0.0:1790391429.664214:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391429.664224:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14387:x1877361130822400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391429.664240:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391429.664257:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b7f9 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391429.664281:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391429.664291:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391429.664307:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978000, rc 0) 00000100:00100000:0.0:1790391429.664353:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130822400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391429.664359:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790391429.664513:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130822400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391429.664527:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391429.664536:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391429.664591:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130822528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790391429.664623:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391429.664656:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391429.665310:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822528 00000100:00100000:2.0:1790391429.665317:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822528 00000100:00100000:2.0:1790391429.665362:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391429.665370:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130822528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790391429.665385:0:14382:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790391429.665400:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790391429.665403:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790391429.665486:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130822528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391429.665493:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391429.665529:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130822528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790391429.665575:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391429.665582:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391429.665601:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391430.234706:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391430.627123:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790391431.257439:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391432.288811:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391433.310666:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391433.641200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391433.641206:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391433.641209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391433.641213:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391433.641215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790391433.641229:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790391433.641233:0:37:0:(import.c:65:import_set_state_nolock()) ffff962427e80800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391433.641246:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff962427e80800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1790391433.641276:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962302089c00 x1877361130822784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391433.641313:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130822784:0@lo:38:kworker.0 00000100:00100000:1.0:1790391433.641386:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391433.641501:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822784 00000100:00100000:1.0:1790391433.641510:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822784 00000100:00100000:1.0:1790391433.641543:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391433.641552:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1877361130822784:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790391433.641584:0:14392:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1790391433.641626:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x35e94fc15449b807 00000004:00100000:1.0:1790391433.641642:0:14392:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790391433.641791:0:14392:0:(import.c:65:import_set_state_nolock()) ffff96243a7f1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391433.641844:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1877361130822784:12345-0@lo:38:kworker.0 Request processed in 291us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391433.641851:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790391433.641891:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962302089c00 x1877361130822784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391433.641905:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790391433.641914:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790391433.641918:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790391433.641920:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962427e80800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790391433.641926:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1877361130822784:0@lo:38:kworker.0 00000100:00100000:2.0:1790391433.642290:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130822656:0@lo:400:kworker.0 00000100:00100000:2.0:1790391433.642332:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391433.644268:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822656 00000100:00100000:1.0:1790391433.644283:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822656 00000100:00100000:1.0:1790391433.644348:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391433.644359:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:3309:x1877361130822656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391433.644444:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:3309:x1877361130822656:12345-0@lo:400:kworker.0 Request processed in 88us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391433.644451:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391433.645838:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130822656:0@lo:400:kworker.0 00010000:00010000:2.0:1790391434.339229:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391434.774199:0:14673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790391435.353348:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391436.378143:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391437.401316:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790391438.165293:0:14823:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca4cb1520 20000000:00000080:1.0:1790391438.165310:0:14823:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96243ba4ac00 uarg=0000000000000000 20000000:01000000:1.0:1790391438.165343:0:14823:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790391438.165349:0:14823:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790391438.165353:0:14823:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790391438.165980:0:14824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1790391438.166350:0:14823:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790391438.172219:0:14823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790391438.172449:0:14823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.172470:0:14823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.172479:0:14823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.172525:0:14823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.172541:0:14823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 11 pid: 14382 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391438.172555:0:14823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14823:1877361130822912:0@lo:104: 00000100:00100000:0.0:1790391438.172629:0:14823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391438.172801:0:14823:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391438.172857:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130822912 00000100:00100000:2.0:1790391438.172864:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130822912 00000100:00100000:2.0:1790391438.172932:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391438.172941:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14823:x1877361130822912:12345-0@lo:104: 00010000:00010000:2.0:1790391438.172956:0:14374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.173055:0:14374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391438.173062:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14823:x1877361130822912:12345-0@lo:104: Request processed in 122us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391438.173070:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790391438.173254:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391438.173260:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173269:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391438.173273:0:14379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173283:0:14379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391438.173291:0:14379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391438.173296:0:14379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391438.173334:0:14379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173341:0:14379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391438.173358:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173366:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96243a2e3600/0x35e94fc15449b7c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b7cf expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173380:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391438.173381:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391438.173383:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391438.173425:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbc90112-ffb7-4b19-a960-3ef7f783602e:3310:1877361130823040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391438.173455:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391438.173483:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130823040 00000100:00100000:1.0:1790391438.173487:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130823040 00010000:00010000:1.0:1790391438.173504:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 12 pid: 14382 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391438.173523:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391438.173529:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:3310:x1877361130823040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391438.173539:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391438.173543:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 12 pid: 14382 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173554:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 12 pid: 14382 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173570:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173582:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173595:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173601:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173608:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173614:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173629:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391438.173634:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173642:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173651:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.173661:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391438.173687:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:3310:x1877361130823040:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.173694:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391438.173730:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbc90112-ffb7-4b19-a960-3ef7f783602e:3310:1877361130823040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391438.174295:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412f10200/0x35e94fc15449b7cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449b7c8 expref: 11 pid: 14382 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391438.174309:0:14823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14823:1877361130822912:0@lo:104: 00010000:00010000:3.0:1790391438.174323:0:14823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.174342:0:14823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.174349:0:14823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.174356:0:14823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96240e979800/0x35e94fc15449b80e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.425339:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391438.745111:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391428/real 1790391428] req@ffff96230208b480 x1877361130820096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391438 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391438.745145:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96230208b480 x1877361130820096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391438 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391438.745159:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391438.745165:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391438.745167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1790391438.745169:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391428/real 1790391428] req@ffff962439727480 x1877361130819968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391438 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391438.745170:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391438.745181:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962439727480 x1877361130819968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391438 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391438.745199:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391438.745209:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790391438.745212:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130823296:0@lo:400:kworker.0 00000100:00100000:2.0:1790391438.745213:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130820096:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790391438.745218:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962402cbf000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391438.745222:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391438.745225:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130819968:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790391438.745261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391438.745265:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790391438.745267:0:37:0:(import.c:65:import_set_state_nolock()) ffff962402cbf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391438.745272:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00100000:1.0:1790391438.745273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391438.745277:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391438.745282:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962402cbf000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391438.745302:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439727480 x1877361130823424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391438.745314:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391438.745317:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391438.745318:0:37:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1790391438.745318:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1790391438.745321:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00100000:1.0:1790391438.745324:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130823168:0@lo:400:kworker.0 00000100:00080000:2.0:1790391438.745328:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391438.745332:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962407ac7800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391438.745343:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439726a00 x1877361130823552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391438.745350:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391438.745361:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130823424:0@lo:8:kworker.0 00000400:00000100:2.0:1790391438.745387:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361130823424 offset 0 length 520: 4 00000100:00100000:2.0:1790391438.745400:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130823552:0@lo:8:kworker.0 00000100:00100000:1.0:1790391438.745411:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130823296 00000100:00100000:1.0:1790391438.745418:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130823296 00000400:00000100:2.0:1790391438.745430:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361130823552 offset 0 length 520: 4 00000100:00100000:1.0:1790391438.745464:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391438.745475:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130823296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.745534:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130823296:12345-0@lo:400:kworker.0 Request processed in 61us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.745542:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790391438.745582:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96230208bb80 x1877361130823296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391438.745595:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130823296:0@lo:400:kworker.0 00000100:00100000:0.0:1790391438.745815:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130823168 00000100:00100000:0.0:1790391438.745821:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130823168 00000100:00100000:0.0:1790391438.745862:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391438.745869:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:3308:x1877361130823168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391438.745922:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:3308:x1877361130823168:12345-0@lo:400:kworker.0 Request processed in 54us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391438.745929:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391438.747366:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130823168:0@lo:400:kworker.0 00010000:00010000:1.0:1790391439.449270:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790391439.964380:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391439.964392:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962411e7e800 from 10 10000000:01000000:0.0:1790391439.964399:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391439.964458:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.964468:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.964480:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391439.964510:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130823680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391439.964598:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391439.964669:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391439.965330:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130823680 00000100:00100000:3.0:1790391439.965340:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130823680 00000100:00100000:3.0:1790391439.965403:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391439.965413:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+11:14387:x1877361130823680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391439.965429:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391439.965447:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b815 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.965473:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b815 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.965484:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b815 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.965492:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2800, rc 0) 00000100:00100000:3.0:1790391439.965555:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130823680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391439.965561:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391439.965779:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130823680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391439.965928:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.965937:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391439.966199:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130823808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391439.966237:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391439.966323:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391439.968943:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130823808 00000100:00100000:1.0:1790391439.968959:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130823808 00000100:00100000:3.0:1790391439.970234:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391439.970266:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130823808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391439.970612:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130823808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (4371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391439.970621:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391439.970823:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130823808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391439.970883:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130823936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391439.970932:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391439.970969:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391439.971362:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130823936 00000100:00100000:2.0:1790391439.971369:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130823936 00000100:00100000:2.0:1790391439.971419:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391439.971427:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130823936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391439.972207:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:14387:x1877361130823936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 777us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391439.972217:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391439.975871:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130823936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790391439.984903:0:14884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790391439.991526:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790391439.991563:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391439.991596:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.991609:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.473148:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391440.863047:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391441.499208:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391442.525503:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391443.547218:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391443.866534:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130824064:0@lo:400:kworker.0 00000100:00100000:2.0:1790391443.866612:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391443.866690:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391443.866695:0:12654:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391443.866698:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391443.866706:0:12654:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790391443.866761:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824064 00000100:00100000:3.0:1790391443.866769:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824064 00000100:00100000:3.0:1790391443.866821:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391443.866831:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:3309:x1877361130824064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391443.868734:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130824192:0@lo:400:kworker.0 00000100:00100000:0.0:1790391443.868808:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391443.869158:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:3309:x1877361130824064:12345-0@lo:400:kworker.0 Request processed in 2324us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391443.869169:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391443.869227:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824192 00000100:00100000:3.0:1790391443.869235:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824192 00000100:00100000:2.0:1790391443.869259:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130824064:0@lo:400:kworker.0 00000100:00100000:3.0:1790391443.869322:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391443.869331:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130824192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391443.869385:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130824192:12345-0@lo:400:kworker.0 Request processed in 56us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391443.869392:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790391443.869413:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96230208ad80 x1877361130824192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391443.869425:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130824192:0@lo:400:kworker.0 00000020:01000004:1.0:1790391444.356738:0:15072:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790391444.356742:0:15072:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1790391444.356860:0:15072:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96243a7f1000 00000020:01000004:1.0:1790391444.356888:0:15072:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1790391444.356901:0:15072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790391444.356925:0:15072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96243a7fcd40) 00000020:00000080:1.0:1790391444.356946:0:15072:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790391444.369142:0:15072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790391444.369309:0:15072:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790391444.369857:0:15072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790391444.370094:0:15072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1790391444.370268:0:15072:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1790391444.370498:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1790391444.370575:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1790391444.370682:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1790391444.371291:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:1.0:1790391444.371592:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1790391444.371787:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:1.0:1790391444.371996:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1790391444.372197:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1790391444.372370:0:15072:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00000020:00000080:1.0:1790391444.372843:0:15072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790391444.372852:0:15072:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790391444.372860:0:15072:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x35e94fc15449b82a 00000020:01000004:1.0:1790391444.372867:0:15072:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1790391444.372888:0:15072:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790391444.372897:0:15072:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790391444.372903:0:15072:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790391444.372909:0:15072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790391444.372941:0:15072:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96243b994d40) 00000020:00000080:1.0:1790391444.372950:0:15072:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1790391444.373984:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391444.374160:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790391444.374166:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790391444.375983:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790391444.375991:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790391444.376408:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790391444.376414:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790391444.378073:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391444.378254:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790391444.378260:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790391444.379050:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790391444.379057:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790391444.392809:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391444.393042:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790391444.393050:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790391444.393841:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391444.393849:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790391444.395297:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790391444.395310:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790391444.397713:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391444.397904:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790391444.397928:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790391444.400982:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790391444.400996:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790391444.429648:0:15072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391444.429847:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790391444.429852:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790391444.430734:0:15072:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790391444.430744:0:15072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790391444.431216:0:15072:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790391444.431235:0:15072:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790391444.431241:0:15072:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790391444.436153:0:15072:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790391444.436186:0:15072:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.108@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1790391444.436190:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790391444.436191:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391444.436192:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391444.436193:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391444.436194:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391444.436195:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391444.436196:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391444.436197:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391444.436197:0:15072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391444.436201:0:15072:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1790391444.436205:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391444.436206:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391444.436206:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391444.436207:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391444.436208:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391444.436208:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391444.436209:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391444.436209:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391444.436210:0:15072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391444.436239:0:15072:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790391444.436255:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391444.436308:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.436425:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a23a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.436483:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824320 00000100:00100000:3.0:1790391444.436489:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824320 00000100:00100000:3.0:1790391444.436610:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391444.436621:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:15072:x1877361130824320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790391444.436649:0:14384:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790391444.436651:0:14384:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1790391444.436655:0:14384:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790391444.440084:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:15072:x1877361130824320:12345-0@lo:253:mount.lustre.0 Request processed in 3456us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.440100:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391444.440176:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391444.440192:0:15072:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790391444.440196:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391444.440198:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391444.440200:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391444.440201:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391444.440203:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391444.440204:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391444.440205:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391444.440206:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391444.440208:0:15072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790391444.440227:0:15072:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96243a7f1000 from lustre-OST0000 10000000:01000000:0.0:1790391444.440252:0:15072:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790391444.440255:0:15072:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391444.440261:0:15072:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96243a7f99c0 local copy 00010000:00010000:0.0:1790391444.440271:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391444.440486:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391444.440531:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.440560:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.440566:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824448 00000100:00100000:3.0:1790391444.440572:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824448 00000100:00100000:3.0:1790391444.440673:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391444.440684:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:15072:x1877361130824448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391444.440824:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:15072:x1877361130824448:12345-0@lo:501:mount.lustre.0 Request processed in 142us (292us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391444.440832:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391444.440852:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824448:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790391444.440872:0:15072:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790391444.441004:0:15072:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790391444.441010:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441036:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391444.441056:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96243a7f1000 10000000:01000000:0.0:1790391444.441061:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790391444.441066:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96243a7f99c0 10000000:01000000:0.0:1790391444.441068:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790391444.441071:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff96243a7f99c0 from 1 10000000:01000000:0.0:1790391444.441074:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790391444.441095:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e979000/0x35e94fc15449b838 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441104:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e979000/0x35e94fc15449b838 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441113:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e979000/0x35e94fc15449b838 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391444.441124:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391444.441145:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.441163:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.441168:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824576 00000100:00100000:3.0:1790391444.441172:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824576 00000100:00100000:3.0:1790391444.441232:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391444.441240:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+12:15072:x1877361130824576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391444.441253:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391444.441262:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3200/0x35e94fc15449b83f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b838 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.441278:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3200/0x35e94fc15449b83f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b838 expref: 13 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.441285:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3200/0x35e94fc15449b83f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b838 expref: 13 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.441290:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3200, rc 0) 00000100:00100000:3.0:1790391444.441315:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+13:15072:x1877361130824576:12345-0@lo:101:mount.lustre.0 Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.441320:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790391444.441344:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391444.441355:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e979000/0x35e94fc15449b838 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b83f expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441370:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e979000/0x35e94fc15449b838 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b83f expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391444.441384:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790391444.441438:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e979000/0x35e94fc15449b838 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b83f expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441446:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e979000/0x35e94fc15449b838 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b83f expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391444.441453:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391444.441456:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391444.441460:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790391444.441462:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790391444.441475:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978200/0x35e94fc15449b846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441482:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e978200/0x35e94fc15449b846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441489:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e978200/0x35e94fc15449b846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391444.441499:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391444.441531:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.441544:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.441554:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824704 00000100:00100000:3.0:1790391444.441558:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824704 00000100:00100000:3.0:1790391444.441617:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391444.441624:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+13:15072:x1877361130824704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391444.441631:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391444.441638:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3400/0x35e94fc15449b84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b846 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.441651:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3400/0x35e94fc15449b84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b846 expref: 14 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.441659:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3400/0x35e94fc15449b84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b846 expref: 14 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.441666:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3400, rc 0) 00000100:00100000:3.0:1790391444.441702:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130824704:12345-0@lo:101:mount.lustre.0 Request processed in 78us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.441708:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790391444.441728:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391444.441739:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e978200/0x35e94fc15449b846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b84d expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.441754:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e978200/0x35e94fc15449b846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b84d expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391444.442351:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790391444.443373:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391444.444246:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790391444.444282:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790391444.444298:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790391444.444322:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790391444.444341:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790391444.444370:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790391444.444432:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790391444.444438:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790391444.444554:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391444.444612:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.444647:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.444667:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824832 00000100:00100000:3.0:1790391444.444674:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824832 00000100:00100000:3.0:1790391444.444716:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391444.444724:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130824832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391444.445042:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130824832:12345-0@lo:501:mount.lustre.0 Request processed in 318us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.445049:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790391444.445066:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391444.445095:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391444.445131:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.445155:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.445216:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130824960 00000100:00100000:3.0:1790391444.445221:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130824960 00000100:00100000:3.0:1790391444.445251:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391444.445258:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130824960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391444.445526:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130824960:12345-0@lo:503:mount.lustre.0 Request processed in 267us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.445533:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790391444.445607:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130824960:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790391444.446225:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391444.446281:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391444.446320:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.446349:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.446427:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825088 00000100:00100000:3.0:1790391444.446433:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825088 00000100:00100000:3.0:1790391444.446463:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391444.446472:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130825088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391444.446642:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130825088:12345-0@lo:502:mount.lustre.0 Request processed in 171us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.446649:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790391444.446667:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391444.446858:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790391444.446901:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790391444.446950:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790391444.446980:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790391444.447000:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790391444.447038:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790391444.447066:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790391444.447084:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790391444.447101:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1790391444.447124:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1790391444.447143:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1790391444.447180:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1790391444.447198:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391444.447229:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.447254:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.447275:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825216 00000100:00100000:3.0:1790391444.447280:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825216 00000100:00100000:3.0:1790391444.447314:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391444.447328:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130825216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391444.447490:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130825216:12345-0@lo:502:mount.lustre.0 Request processed in 162us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.447497:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790391444.447523:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391444.447575:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1790391444.447582:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1790391444.448330:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391444.448340:0:15086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1790391444.448347:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391444.448350:0:15086:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790391444.448355:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391444.448376:0:15086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96243fa2b380) 00000020:00000080:0.0:1790391444.448408:0:15086:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790391444.448413:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790391444.448482:0:15086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96243a7f1000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790391444.448487:0:15086:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790391444.448494:0:15086:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x35e94fc15449b85b 00010000:00010000:0.0:1790391444.451378:0:15086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1790391444.451715:0:15086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1790391444.452955:0:15086:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1790391444.454220:0:15086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790391444.454231:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391444.454236:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.454238:0:15086:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790391444.454241:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790391444.454243:0:15086:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1790391444.454244:0:15086:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391444.454245:0:15086:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391444.454246:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790391444.454248:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.454249:0:15086:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790391444.454250:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391444.454252:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.454253:0:15086:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790391444.454254:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790391444.454255:0:15086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790391444.454257:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391444.454258:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.454258:0:15086:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790391444.454260:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391444.454261:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.454261:0:15086:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790391444.454263:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790391444.454308:0:15086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391444.454310:0:15086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.454311:0:15086:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790391444.454313:0:15086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1790391444.454402:0:15072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1790391444.454428:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790391444.454458:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978200/0x35e94fc15449b846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b84d expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.454471:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e978200/0x35e94fc15449b846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b84d expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391444.454479:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96243a7f1000 from 1 10000000:01000000:1.0:1790391444.454483:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391444.454676:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.454685:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.454697:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391444.454723:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391444.454788:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.454881:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.454948:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825344 00000100:00100000:3.0:1790391444.454955:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825344 00000100:00100000:3.0:1790391444.455005:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790391444.455031:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+14:15072:x1877361130825344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391444.455044:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391444.455055:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b862 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.455076:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b862 expref: 15 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.455084:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b862 expref: 15 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391444.455090:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3000, rc 0) 00000100:00100000:3.0:1790391444.455124:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825344:12345-0@lo:101:mount.lustre.0 Request processed in 111us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.455131:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391444.455161:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391444.455180:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.455190:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391444.455755:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790391444.456284:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391444.456674:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790391444.456717:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790391444.456777:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790391444.456786:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790391444.456926:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391444.456981:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.457118:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391444.457165:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825472 00000100:00100000:2.0:1790391444.457173:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825472 00000100:00100000:2.0:1790391444.457214:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391444.457223:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391444.457491:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825472:12345-0@lo:501:mount.lustre.0 Request processed in 268us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391444.457499:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391444.457966:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391444.457998:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391444.458135:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.458205:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fe840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391444.458245:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825600 00000100:00100000:0.0:1790391444.458250:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825600 00000100:00100000:0.0:1790391444.458318:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790391444.458327:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391444.458494:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825600:12345-0@lo:503:mount.lustre.0 Request processed in 168us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391444.458501:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391444.458584:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825600:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391444.459278:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391444.459357:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391444.459403:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391444.459612:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962412bbdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391444.459731:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825728 00000100:00100000:1.0:1790391444.459737:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825728 00000100:00100000:1.0:1790391444.459762:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790391444.459769:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391444.459976:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825728:12345-0@lo:502:mount.lustre.0 Request processed in 207us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391444.459983:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391444.460278:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391444.460477:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790391444.460510:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790391444.460987:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790391444.461057:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790391444.461095:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790391444.461142:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790391444.461169:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790391444.461185:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1790391444.461215:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391444.461253:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391444.461282:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962407f78300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391444.461286:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825856 00000100:00100000:3.0:1790391444.461292:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825856 00000100:00100000:3.0:1790391444.461330:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391444.461339:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391444.461490:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825856:12345-0@lo:502:mount.lustre.0 Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.461497:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391444.461959:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391444.462051:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790391444.462061:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1790391444.462803:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391444.462814:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.462816:0:15090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790391444.462823:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96243a7f1000 00000020:00000080:3.0:1790391444.462825:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391444.462833:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391444.462840:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.462842:0:15090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790391444.462845:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391444.462847:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.462848:0:15090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790391444.462851:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96243a7f1000 00000020:00000080:3.0:1790391444.462853:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391444.462960:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391444.462964:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.462965:0:15090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790391444.462968:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391444.462970:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.462972:0:15090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391444.462975:0:15090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96243a7f1000 00000020:00000080:3.0:1790391444.462977:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391444.466114:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391444.466127:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391444.466538:0:15090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790391444.466546:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1790391444.466694:0:15072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790391444.466725:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391444.466775:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.466787:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391444.466838:0:15072:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790391444.466842:0:15072:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96243a7f1000 10000000:01000000:0.0:1790391444.466845:0:15072:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96243a7f1000 10000000:01000000:0.0:1790391444.466850:0:15072:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391444.466856:0:15072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96243a7f1000 from 1 10000000:01000000:0.0:1790391444.466858:0:15072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790391444.466895:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978800/0x35e94fc15449b870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.466925:0:15072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e978800/0x35e94fc15449b870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.466937:0:15072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e978800/0x35e94fc15449b870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391444.466963:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391444.467052:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.467093:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130825984 00000100:00100000:0.0:1790391444.467101:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130825984 00000100:00100000:0.0:1790391444.467157:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391444.467167:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130825984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391444.467181:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391444.467193:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e979c00/0x35e94fc15449b877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b870 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.467215:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e979c00/0x35e94fc15449b877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b870 expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.467225:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e979c00/0x35e94fc15449b877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b870 expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.467233:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979c00, rc 0) 00000100:00100000:0.0:1790391444.467265:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130825984:12345-0@lo:101:mount.lustre.0 Request processed in 99us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391444.467272:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391444.467313:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408213840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391444.467340:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130825984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391444.467476:0:15072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e978800/0x35e94fc15449b870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b877 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391444.467485:0:15072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e978800/0x35e94fc15449b870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b877 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391444.468140:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1790391444.468526:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391444.468756:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790391444.468801:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790391444.468835:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790391444.468880:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790391444.468930:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1790391444.468995:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1790391444.469104:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1790391444.469142:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1790391444.469190:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1790391444.469224:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1790391444.469261:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1790391444.469322:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1790391444.474075:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1790391444.474151:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1790391444.474244:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1790391444.474285:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1790391444.474322:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1790391444.474385:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1790391444.474427:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1790391444.474464:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1790391444.474512:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1790391444.474564:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1790391444.474603:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1790391444.474663:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1790391444.474702:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1790391444.474739:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1790391444.474785:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1790391444.474819:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1790391444.475449:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1790391444.475464:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1790391444.475570:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391444.475641:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.475686:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408213840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391444.476179:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130826112 00000100:00100000:2.0:1790391444.476188:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130826112 00000100:00100000:2.0:1790391444.476247:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391444.476257:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391444.476545:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826112:12345-0@lo:501:mount.lustre.0 Request processed in 288us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391444.476552:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790391444.477080:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391444.477120:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391444.477158:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391444.477181:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962408213840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391444.480124:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130826240 00000100:00100000:0.0:1790391444.480137:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130826240 00000100:00100000:0.0:1790391444.480191:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790391444.480201:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391444.480541:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826240:12345-0@lo:503:mount.lustre.0 Request processed in 341us (3381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391444.480548:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391444.480661:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790391444.481375:0:15072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391444.481462:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391444.481591:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.481656:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391444.481701:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130826368 00000100:00100000:0.0:1790391444.481706:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130826368 00000100:00100000:0.0:1790391444.481778:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790391444.481787:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391444.481992:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826368:12345-0@lo:502:mount.lustre.0 Request processed in 206us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391444.482008:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790391444.482108:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391444.482335:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790391444.482383:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790391444.482413:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790391444.482466:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790391444.482502:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790391444.482565:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790391444.482600:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790391444.482640:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790391444.482687:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790391444.482716:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790391444.482744:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790391444.482784:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790391444.482816:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790391444.482847:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790391444.482903:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790391444.482950:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790391444.482982:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790391444.483064:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790391444.483103:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790391444.483135:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790391444.483178:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790391444.483209:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790391444.483237:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790391444.483280:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790391444.483329:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1790391444.483364:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1790391444.483423:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1790391444.483461:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1790391444.483504:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1790391444.483551:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1790391444.483599:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1790391444.483632:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1790391444.483664:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1790391444.483712:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1790391444.483747:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1790391444.483795:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1790391444.483830:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1790391444.483862:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1790391444.483919:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1790391444.483956:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1790391444.483994:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391444.484077:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.484712:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391444.484768:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130826496 00000100:00100000:2.0:1790391444.484775:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130826496 00000100:00100000:2.0:1790391444.484816:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391444.484824:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391444.485409:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826496:12345-0@lo:502:mount.lustre.0 Request processed in 584us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391444.485423:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790391444.485621:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391444.485714:0:15072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790391444.485728:0:15072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790391444.487143:0:15095:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790391444.487160:0:15095:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96243b993380) 00000020:00000080:1.0:1790391444.487180:0:15095:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1790391444.487267:0:15095:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96243a7f1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790391444.487271:0:15095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96243a7f1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790391444.487273:0:15095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96243a7f1000 3 00010000:00080000:1.0:1790391444.487314:0:15095:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96243971d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.108@tcp at head 00010000:00010000:2.0:1790391444.494833:0:15095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1790391444.499387:0:15095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790391444.499429:0:15095:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790391444.499443:0:15095:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x35e94fc15449b885 00000100:00080000:1.0:1790391444.499453:0:15095:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391444.499459:0:15095:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96243971d000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1790391444.499505:0:15095:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962302088a80 x1877361130826624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391444.499543:0:15095:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790391444.499570:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391444.499574:0:12654:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391444.499577:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391444.499580:0:12654:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790391444.500072:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1877361130826624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790391444.500141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.501974:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130826624 00000100:00100000:1.0:1790391444.501987:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130826624 00000100:00100000:1.0:1790391444.502049:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391444.502059:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1877361130826624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790391444.502087:0:14392:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:1.0:1790391444.502155:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x35e94fc15449b88c 00000004:00100000:1.0:1790391444.502172:0:14392:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790391444.502203:0:14392:0:(import.c:65:import_set_state_nolock()) ffff96243f7b8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391444.502276:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1877361130826624:12345-0@lo:38:llog_process_th.0 Request processed in 218us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391444.502283:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790391444.502330:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962302088a80 x1877361130826624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391444.502352:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391444.502361:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1790391444.502368:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790391444.502372:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790391444.502380:0:3306:0:(import.c:65:import_set_state_nolock()) ffff96243971d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790391444.502386:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1877361130826624:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790391444.503714:0:15095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1790391444.506086:0:15072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790391444.506182:0:15072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391444.506205:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e978800/0x35e94fc15449b870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b877 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.506217:0:15072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e978800/0x35e94fc15449b870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b877 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790391444.506264:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790391444.506267:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790391444.506268:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391444.506269:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391444.506271:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391444.506272:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391444.506274:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391444.506275:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391444.506276:0:15072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391444.506280:0:15072:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1790391444.506282:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391444.506283:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790391444.506285:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391444.506286:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391444.506287:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391444.506288:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391444.506289:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391444.506290:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391444.506291:0:15072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391444.506315:0:15072:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790391444.506334:0:15072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790391444.506697:0:15072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.506740:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130826752 00000100:00100000:1.0:1790391444.506747:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130826752 00000100:00100000:1.0:1790391444.506795:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790391444.506804:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15072:x1877361130826752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790391444.506843:0:14385:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790391444.506856:0:14385:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790391444.508104:0:15072:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15540 going to sleep for 11 seconds 20000000:01000000:2.0:1790391444.538323:0:14385:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790391444.538337:0:14385:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790391444.538367:0:14406:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790391444.538372:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790391444.538396:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538415:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538423:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538462:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538476:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 16 pid: 14384 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391444.538491:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1877361130826880:0@lo:104: 00000100:00100000:2.0:1790391444.538570:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391444.538603:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff962403f45e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391444.538646:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130826880 00000100:00100000:2.0:1790391444.538654:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130826880 00000100:00100000:2.0:1790391444.538698:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391444.538709:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14406:x1877361130826880:12345-0@lo:104: 00010000:00010000:2.0:1790391444.538724:0:14374:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538780:0:14374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391444.538786:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14406:x1877361130826880:12345-0@lo:104: Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391444.538794:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790391444.538829:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391444.538835:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538843:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391444.538847:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538856:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391444.538863:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391444.538867:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391444.538889:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538894:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391444.538927:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.538934:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96243a2e3800/0x35e94fc15449b7f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b800 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391444.538945:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130827008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391444.538961:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391444.538963:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391444.538964:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391444.538976:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.539006:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827008 00000100:00100000:2.0:1790391444.539008:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1877361130826880:0@lo:104: 00000100:00100000:1.0:1790391444.539009:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827008 00010000:00010000:2.0:1790391444.539047:0:14406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539048:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 17 pid: 14384 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391444.539068:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391444.539075:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:3307:x1877361130827008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391444.539085:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391444.539089:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 17 pid: 14384 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539098:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 17 pid: 14384 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539110:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96240e978000/0x35e94fc15449b800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449b7f9 expref: 17 pid: 14384 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539122:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539130:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790391444.539142:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003962124s 00010000:00010000:1.0:1790391444.539152:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539159:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539166:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539173:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539177:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391444.539181:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539188:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539212:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.539221:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391444.539257:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3307:x1877361130827008:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391444.539264:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391444.539346:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130827008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391444.539435:0:14406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.539443:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391444.539449:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412f11e00/0x35e94fc15449b893 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391444.543286:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:15072:x1877361130826752:12345-0@lo:253:mount.lustre.0 Request processed in 36474us (36581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391444.543300:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790391444.543435:0:15072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15072:1877361130826752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790391444.543453:0:15072:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790391444.543457:0:15072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391444.543458:0:15072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790391444.543460:0:15072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391444.543475:0:15072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391444.543476:0:15072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391444.543478:0:15072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391444.543479:0:15072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391444.543481:0:15072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391444.543482:0:15072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790391444.543497:0:15072:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790391444.549198:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391444.549429:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790391444.549649:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391444.549789:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790391444.549920:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790391444.550208:0:15072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790391444.551435:0:15072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1790391444.569844:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1790391444.592358:0:15072:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790391444.592365:0:15072:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790391444.592398:0:15072:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790391444.592474:0:15072:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790391444.592499:0:15072:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790391444.592523:0:15072:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790391445.593303:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790391446.236662:0:14387:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790391446.236674:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962411e7e800 from 7 10000000:01000000:2.0:1790391446.236681:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391446.236755:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391446.236770:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391446.236804:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391446.236857:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130827136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391446.236963:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391446.237060:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962403f27180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391446.238158:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827136 00000100:00100000:3.0:1790391446.238173:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827136 00000100:00100000:3.0:1790391446.238256:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790391446.238269:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+15:14387:x1877361130827136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391446.238289:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391446.238313:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b89a expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391446.238361:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b89a expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391446.238374:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b89a expref: 16 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391446.238385:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3c00, rc 0) 00000100:00100000:3.0:1790391446.238464:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:14387:x1877361130827136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391446.238472:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790391446.238541:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130827136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391446.238566:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391446.238575:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391446.238644:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301245f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130827264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790391446.238686:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391446.238714:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962406a46300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391446.238731:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827264 00000100:00100000:3.0:1790391446.238735:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827264 00000100:00100000:3.0:1790391446.238758:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790391446.238765:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:14387:x1877361130827264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790391446.238780:0:14385:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790391446.238800:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790391446.238808:0:14385:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1790391446.238900:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:14387:x1877361130827264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391446.238908:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790391446.238940:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301245f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130827264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790391446.239004:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391446.239055:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391446.239064:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391446.622945:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391447.641591:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391448.668374:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391449.689564:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391450.015509:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391450.015517:0:12654:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391450.015520:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391450.015523:0:12654:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391450.015572:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130827392:0@lo:400:kworker.0 00000100:00100000:2.0:1790391450.015645:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391450.015705:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130827520:0@lo:400:kworker.0 00000100:00100000:2.0:1790391450.015730:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391450.015746:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391450.015751:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130827648:0@lo:400:kworker.0 00000100:00100000:2.0:1790391450.015771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391450.015799:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827392 00000100:00100000:2.0:1790391450.015805:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827392 00000100:00100000:3.0:1790391450.015968:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827520 00000100:00100000:3.0:1790391450.015973:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827520 00000100:00100000:3.0:1790391450.016000:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827648 00000100:00100000:3.0:1790391450.016003:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827648 00000100:00100000:3.0:1790391450.016052:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391450.016061:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130827520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391450.016123:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130827520:12345-0@lo:400:kworker.0 Request processed in 63us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391450.016131:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391450.016146:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391450.016153:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130827648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391450.016177:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130827648:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391450.016183:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790391450.016211:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391450.016583:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790391450.016603:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3308:x1877361130827392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391450.016639:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3308:x1877361130827392:12345-0@lo:400:kworker.0 Request processed in 37us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391450.016645:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1790391450.016703:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962439724000 x1877361130827648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391450.016718:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130827648:0@lo:400:kworker.0 00010000:00080000:3.0:1790391450.016768:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962439725180 x1877361130827520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391450.016776:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130827520:0@lo:400:kworker.0 00000100:00100000:3.0:1790391450.016836:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130827392:0@lo:400:kworker.0 00000040:00080000:2.0:1790391450.075175:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391450.713219:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391451.737836:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391452.247359:0:15438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790391452.762713:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391453.721123:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391438/real 1790391438] req@ffff962439727480 x1877361130823424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391453 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391453.721167:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962439727480 x1877361130823424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391453 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391453.721179:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391438/real 1790391438] req@ffff962439726a00 x1877361130823552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391453 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391453.721190:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962439726a00 x1877361130823552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391453 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790391453.721213:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962402cbf000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391453.721238:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790391453.721243:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130823424:0@lo:8:kworker.0 00000100:00080000:3.0:1790391453.721267:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391453.721274:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790391453.721277:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130823552:0@lo:8:kworker.0 00000100:00100000:3.0:1790391453.721379:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130827776:0@lo:400:kworker.0 00000100:00100000:3.0:1790391453.721471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391453.721585:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827776 00000100:00100000:1.0:1790391453.721595:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827776 00000100:00100000:1.0:1790391453.721659:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790391453.721671:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3307:x1877361130827776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790391453.721762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391453.721768:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790391453.721772:0:37:0:(import.c:65:import_set_state_nolock()) ffff962402cbf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391453.721777:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1790391453.721782:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790391453.721788:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962402cbf000 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391453.721830:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439724e00 x1877361130827904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391453.721845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391453.721848:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391453.721850:0:37:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391453.721854:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:2.0:1790391453.721856:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790391453.721861:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962407ac7800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:2.0:1790391453.721872:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439726d80 x1877361130828032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391453.723436:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130828160:0@lo:400:kworker.0 00000100:00100000:0.0:1790391453.723535:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391453.723643:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828160 00000100:00100000:0.0:1790391453.723654:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828160 00000100:00100000:0.0:1790391453.723717:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391453.723726:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130828160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391453.724040:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877361130828160:12345-0@lo:400:kworker.0 Request processed in 290us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391453.724049:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790391453.724104:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962439724700 x1877361130828160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391453.724121:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877361130828160:0@lo:400:kworker.0 00000100:00100000:1.0:1790391453.724293:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3307:x1877361130827776:12345-0@lo:400:kworker.0 Request processed in 2621us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391453.724304:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790391453.724502:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391453.724515:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130828288:0@lo:400:kworker.0 00000100:00100000:2.0:1790391453.724673:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391453.724915:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828288 00000100:00100000:1.0:1790391453.724923:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828288 00000100:00100000:1.0:1790391453.724989:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391453.725000:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130828288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391453.725131:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877361130828288:12345-0@lo:400:kworker.0 Request processed in 134us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391453.725140:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790391453.725161:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790391453.725188:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962439725500 x1877361130828288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391453.725219:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1877361130828288:0@lo:400:kworker.0 00000100:00100000:2.0:1790391453.726152:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130827904:0@lo:8:kworker.0 00000100:00100000:2.0:1790391453.726226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391453.726282:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130828032:0@lo:8:kworker.0 00000100:00100000:2.0:1790391453.726305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391453.726355:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130827904 00000100:00100000:2.0:1790391453.726375:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130827904 00000100:00100000:2.0:1790391453.726407:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828032 00000100:00100000:2.0:1790391453.726410:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828032 00000100:00100000:2.0:1790391453.726424:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391453.726431:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1877361130827904:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790391453.726465:0:15075:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1790391453.726503:0:15075:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449b8a8 00002000:00100000:2.0:1790391453.726522:0:15075:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96241ffc6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790391453.726527:0:15075:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790391453.726530:0:15075:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790391453.727515:0:15075:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790391453.727553:0:15075:0:(import.c:65:import_set_state_nolock()) ffff96241ffc6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391453.728548:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1877361130827904:12345-0@lo:8:kworker.0 Request processed in 2109us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391453.728575:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391453.728624:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391453.728632:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1877361130828032:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790391453.728654:0:15075:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391453.729789:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130827776:0@lo:400:kworker.0 00010000:00080000:0.0:1790391453.732714:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962439724e00 x1877361130827904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391453.732734:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391453.732748:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790391453.732770:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790391453.732778:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790391453.732796:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962402cbf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790391453.733670:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790391453.733685:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130827904:0@lo:8:kworker.0 00000004:00080000:1.0:1790391453.737798:0:14413:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1790391453.737852:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1877361130828544:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790391453.737958:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391453.738003:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff962411a15540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391453.738048:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130828416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391453.738083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391453.738137:0:15074:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790391453.738146:0:15074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1790391453.738284:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828544 00000100:00100000:1.0:1790391453.738292:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828544 00000100:00080000:1.0:1790391453.738362:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391453.738452:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391453.738463:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14413:x1877361130828544:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790391453.739931:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828416 00000100:00100000:0.0:1790391453.739945:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828416 00000100:00100000:0.0:1790391453.740010:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391453.740206:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130828416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391453.740251:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391453.740357:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130828416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391453.740365:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790391453.740432:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962302088a80 x1877361130828416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391453.740460:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130828416:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1790391453.746753:0:14412:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790391453.747427:0:14412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 489081409818ns, next at 0ns, rc = 0 00002000:00080000:0.0:1790391453.757554:0:15498:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1790391453.757569:0:15498:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1790391453.757576:0:15498:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:2.0:1790391453.759681:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1877361130828032:12345-0@lo:8:kworker.0 Request processed in 31039us (33365us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391453.759701:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790391453.759792:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391453.759799:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391453.759804:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130828032:0@lo:8:kworker.0 00002000:00010000:0.0:1790391453.772505:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790391453.772523:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.772546:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1790391453.772552:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391453.772560:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.772583:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.772603:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.772611:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.772648:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391453.772810:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391453.772821:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.772837:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391453.772843:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.772855:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.772881:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.772889:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019126cc2/0x35e94fc15449b8af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.772933:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391453.772936:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391453.772938:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391453.779725:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790391453.780265:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.780292:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1790391453.780298:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391453.780306:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.780329:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.780344:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.780354:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.780705:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391453.781434:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790391453.781443:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.781455:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1790391453.781459:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391453.781464:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.781476:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.781485:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.781493:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782213:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391453.782225:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782237:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.782244:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782255:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782294:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782303:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8879c06/0x35e94fc15449b8b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782328:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.782332:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782338:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.782342:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.782349:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.783475:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.783495:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.783496:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.783500:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.786192:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391453.786212:0:15498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddced40e/0x35e94fc15449b8bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.786463:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.789460:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391453.798082:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790391453.798102:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798134:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1790391453.798140:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391453.798148:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798169:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798183:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798193:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798216:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391453.798235:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391453.798243:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798252:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391453.798258:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798268:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798301:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798311:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e56462e/0x35e94fc15449b8c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.798335:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.798338:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.798339:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.802454:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.802475:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.802499:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.802506:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.802514:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.802531:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.802543:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.802552:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.805432:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.805454:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.805464:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.805476:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.805482:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.805494:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.805527:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.805537:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005db82245/0x35e94fc15449b8cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.805994:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.805997:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.805999:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.806717:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.806728:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806767:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.806773:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.806781:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806799:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806818:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806827:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806864:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.806879:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.806885:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806892:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.806896:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806905:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806920:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806928:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c79fa341/0x35e94fc15449b8d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.806943:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.806945:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.806946:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.807416:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.807423:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807433:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.807442:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.807447:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807456:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807464:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807470:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807487:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.807497:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.807502:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807509:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.807513:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807521:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807533:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807552:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f346117/0x35e94fc15449b8d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.807565:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.807567:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.807569:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.808973:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.808984:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809000:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.809005:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.809011:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809046:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809055:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809063:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809080:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.809092:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.809104:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809112:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.809116:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809125:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809141:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809150:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce882dda/0x35e94fc15449b8e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.809169:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.809171:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.809173:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.809998:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.810008:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810040:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.810044:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.810049:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810074:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810082:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810089:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810104:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.810115:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.810120:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810127:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.810130:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810137:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810150:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810158:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009df63fab/0x35e94fc15449b8e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.810182:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.810183:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.810185:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.815192:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.815209:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.815234:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.815241:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.815248:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.815268:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.815281:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.815290:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.815319:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391453.816469:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391453.816482:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.816497:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391453.816503:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.816515:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.816538:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.816546:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4c09f8/0x35e94fc15449b8ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.816587:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.816589:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.816591:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.818718:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.818734:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.818788:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.818793:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.818802:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.818831:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.818845:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.818855:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.818890:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790391453.819537:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.819546:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.819556:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.819560:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.819565:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.819577:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.819597:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.819605:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.819627:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790391453.820082:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.820090:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820099:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.820102:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.820106:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820116:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820124:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820132:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820151:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1790391453.820582:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.820589:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820598:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.820602:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.820606:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820616:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820624:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820632:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.820640:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1790391453.821103:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.821109:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821119:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.821127:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.821131:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821141:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821150:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821157:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821164:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1790391453.821549:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.821555:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821563:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.821567:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.821571:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821581:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821590:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821605:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.821613:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1790391453.821866:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1790391453.821876:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.821885:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391453.821891:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.821901:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.821925:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.821933:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa6ad45/0x35e94fc15449b8f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.821959:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1790391453.821964:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.821979:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391453.821983:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.821990:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822000:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822007:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71dab4c/0x35e94fc15449b8fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822039:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790391453.822044:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822051:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391453.822054:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822061:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822070:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822082:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000793ac62c/0x35e94fc15449b903 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822096:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790391453.822099:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822105:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391453.822108:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822116:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822126:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822132:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f3f0fa/0x35e94fc15449b90a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822142:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391453.822146:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822152:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391453.822160:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822167:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822176:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822183:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e27520c/0x35e94fc15449b911 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822194:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391453.822197:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822202:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e960a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391453.822204:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822210:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822218:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822224:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003de3eaae/0x35e94fc15449b918 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391453.822243:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391453.822245:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391453.822247:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.822953:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.822962:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.822976:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.822980:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.822986:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.822997:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823006:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823031:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823053:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.823064:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.823068:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823085:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.823089:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823097:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823110:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823117:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b91f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823132:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.823134:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.823135:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.823684:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.823692:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823700:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.823703:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.823708:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823717:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823731:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823738:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823749:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.823770:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.823774:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823781:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.823784:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823792:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823803:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823811:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b926 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.823825:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.823833:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.823834:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.824304:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.824311:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824319:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.824322:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.824327:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824336:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824344:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824350:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824364:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.824373:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.824377:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824383:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.824387:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824406:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824417:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824425:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b92d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.824438:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.824440:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.824442:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.830068:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.830085:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830106:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.830112:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.830121:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830140:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830153:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830175:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830196:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.830212:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.830218:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830227:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.830231:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830240:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830263:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830271:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b934 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.830290:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.830292:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.830294:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.833218:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.843292:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.843322:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843344:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.843350:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.843359:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843378:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843390:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843398:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843420:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.843437:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.843444:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843453:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.843459:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843469:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843495:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843504:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b51429/0x35e94fc15449b93b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.843525:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.843527:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.843529:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.848514:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.848532:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.848553:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.848559:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.848567:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.848585:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.848597:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.848605:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.848642:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391453.849289:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391453.849299:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.849309:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391453.849315:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.849325:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.849345:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.849352:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d993fb/0x35e94fc15449b942 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391453.849370:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.849372:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391453.849373:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.851147:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.851162:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851180:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.851185:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.851191:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851205:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851216:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851224:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851244:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391453.851260:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391453.851266:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851274:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391453.851285:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851295:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851311:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851319:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378df2e0/0x35e94fc15449b949 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851337:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.851339:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391453.851341:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790391453.851851:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.851857:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851867:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.851870:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.851875:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851884:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851892:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.851904:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.852613:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790391453.853551:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.853573:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.853590:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.853595:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.853601:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.853614:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.853624:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.853633:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.853662:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790391453.854207:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.854215:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854233:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.854236:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.854241:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854253:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854263:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854271:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854281:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1790391453.854699:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790391453.854706:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854714:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1790391453.854717:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391453.854721:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854731:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854752:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854771:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391453.854780:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:1.0:1790391453.855407:0:15498:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1790391453.855540:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14413:x1877361130828544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 117072us (117576us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391453.855564:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391453.855646:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1877361130828544:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790391453.855664:0:14413:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1790391453.855724:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302088700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1877361130828672:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790391453.855778:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391453.855842:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624012ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391453.855866:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828672 00000100:00100000:1.0:1790391453.855874:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828672 00000100:00100000:1.0:1790391453.856345:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391453.856357:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1877361130828672:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1790391453.856409:0:15074:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1790391453.856685:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790391453.856697:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856710:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391453.856715:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856727:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856771:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856781:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcb033a/0x35e94fc15449b950 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856879:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790391453.856885:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856892:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391453.856895:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856982:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.856994:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857002:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef7a2bc8/0x35e94fc15449b957 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857037:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391453.857042:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857055:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391453.857058:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857067:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857078:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857086:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000671f002a/0x35e94fc15449b95e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857100:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391453.857104:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857111:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391453.857115:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857122:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857132:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857147:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449b965 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391453.857162:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391453.857163:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391453.857165:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391453.857175:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790391453.870164:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1790391453.880075:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14413:x1877361130828672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23703us (24279us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790391453.880108:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391453.880216:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302088700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14413:1877361130828672:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790391453.880238:0:14413:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1790391454.810515:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790391455.228348:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1790391455.228602:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790391455.834841:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391456.857862:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391457.882212:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391458.905999:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391459.229462:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391459.229471:0:12654:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790391459.229475:0:12654:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391459.229487:0:12654:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1790391459.229494:0:12654:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790391459.229503:0:12654:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962407ac7800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:1.0:1790391459.229530:0:12654:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962302089f80 x1877361130829056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391459.229605:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130828928:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.229707:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.229781:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391459.229787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130828800:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.229843:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.229880:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130829056:0@lo:8:kworker.0 00000100:00100000:1.0:1790391459.229912:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.229943:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130829184:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.229973:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.229994:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391459.229999:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130829312:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.230047:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.230231:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828928 00000100:00100000:1.0:1790391459.230239:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828928 00000100:00100000:1.0:1790391459.230311:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829056 00000100:00100000:1.0:1790391459.230315:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829056 00000100:00100000:1.0:1790391459.230337:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391459.230348:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130828928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.230409:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130828928:12345-0@lo:400:kworker.0 Request processed in 63us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.230418:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391459.230441:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391459.230446:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1877361130829056:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790391459.230466:0:15075:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790391459.235171:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829184 00000100:00100000:3.0:1790391459.235201:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829184 00000100:00100000:3.0:1790391459.235295:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829312 00000100:00100000:3.0:1790391459.235300:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829312 00000100:00100000:3.0:1790391459.235340:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391459.235354:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130829184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391459.235488:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130829184:12345-0@lo:400:kworker.0 Request processed in 137us (5513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391459.235497:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391459.235515:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391459.235522:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130829312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391459.235551:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130829312:12345-0@lo:400:kworker.0 Request processed in 31us (5504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391459.235558:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391459.235591:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130828800 00000100:00100000:3.0:1790391459.235595:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130828800 00000100:00100000:3.0:1790391459.235624:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790391459.235631:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3308:x1877361130828800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391459.235663:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3308:x1877361130828800:12345-0@lo:400:kworker.0 Request processed in 33us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391459.235680:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790391459.245393:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130829440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391459.245507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790391459.246196:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391459.246206:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391459.246254:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130828800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.246272:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790391459.246292:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130828928:0@lo:400:kworker.0 00000100:00100000:3.0:1790391459.248044:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829440 00000100:00100000:3.0:1790391459.248134:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829440 00000100:00100000:3.0:1790391459.248200:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391459.248210:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130829440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391459.248259:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391459.248355:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130829440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391459.248362:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391459.248425:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130829440:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790391459.249410:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962302089500 x1877361130829312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391459.249426:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130829312:0@lo:400:kworker.0 00010000:00080000:0.0:1790391459.249442:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962302089180 x1877361130829184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391459.249449:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130829184:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.278655:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1877361130829056:12345-0@lo:8:kworker.0 Request processed in 48193us (48727us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391459.279363:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790391459.279458:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391459.279466:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391459.279472:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130829056:0@lo:8:kworker.0 00010000:00010000:0.0:1790391459.929142:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391460.317582:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391460.954188:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391461.294432:0:15791:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790391461.294438:0:15791:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790391461.294647:0:15791:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96242d067000 00000020:01000004:0.0:1790391461.294671:0:15791:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790391461.294690:0:15791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790391461.294711:0:15791:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96243fa28000) 00000020:00000080:0.0:1790391461.294733:0:15791:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790391461.342957:0:15791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790391461.344467:0:15791:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790391461.346686:0:15791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790391461.348144:0:15791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790391461.348426:0:15791:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790391461.350978:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 509: rc = 0 00100000:10000000:2.0:1790391461.351377:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 509: rc = 0 00100000:10000000:2.0:1790391461.351488:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 509: rc = 0 00100000:10000000:2.0:1790391461.352702:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 645: rc = 0 00100000:10000000:2.0:1790391461.354435:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 645: rc = 0 00100000:10000000:2.0:1790391461.354767:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:2.0:1790391461.356611:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 645: rc = 0 00100000:10000000:2.0:1790391461.357644:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1790391461.358606:0:15791:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 645: rc = 0 00000020:00000080:2.0:1790391461.361390:0:15791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790391461.361409:0:15791:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391461.361424:0:15791:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x35e94fc15449b973 00000020:01000004:2.0:1790391461.361434:0:15791:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790391461.361468:0:15791:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391461.361472:0:15791:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391461.361479:0:15791:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790391461.361510:0:15791:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790391461.361515:0:15791:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790391461.397120:0:15791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790391461.397179:0:15791:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.108@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1790391461.397184:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790391461.397186:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790391461.397188:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391461.397190:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391461.397191:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391461.397193:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391461.397195:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391461.397196:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391461.397198:0:15791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391461.397203:0:15791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1790391461.397205:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790391461.397206:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790391461.397208:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391461.397209:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391461.397210:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391461.397211:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391461.397212:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391461.397213:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391461.397214:0:15791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391461.397251:0:15791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790391461.397279:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790391461.398346:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391461.398439:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962410cadc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.398551:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829568 00000100:00100000:0.0:1790391461.398576:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829568 00000100:00100000:0.0:1790391461.398659:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391461.398671:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15791:x1877361130829568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790391461.398729:0:14382:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790391461.398733:0:14382:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790391461.398738:0:14382:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790391461.443055:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15791:x1877361130829568:12345-0@lo:253:mount.lustre.0 Request processed in 44335us (44662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.443076:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790391461.443289:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829568:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790391461.443313:0:15791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790391461.443317:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790391461.443319:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790391461.443321:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391461.443323:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391461.443324:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391461.443326:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391461.443328:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391461.443330:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391461.443332:0:15791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790391461.443362:0:15791:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96242d067000 from lustre-OST0001 10000000:01000000:3.0:1790391461.443400:0:15791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790391461.443404:0:15791:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790391461.443413:0:15791:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96243a7f99c0 local copy 00010000:00010000:3.0:1790391461.443427:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391461.443797:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391461.443845:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391461.443893:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962410cade40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.444114:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829696 00000100:00100000:0.0:1790391461.444124:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829696 00000100:00100000:0.0:1790391461.444183:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391461.444195:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15791:x1877361130829696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391461.445437:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15791:x1877361130829696:12345-0@lo:501:mount.lustre.0 Request processed in 1233us (1580us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391461.445451:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391461.448495:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301245180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829696:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790391461.448545:0:15791:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790391461.450134:0:15791:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790391461.450154:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.450170:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e961800/0x35e94fc15449b720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b727 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391461.451739:0:15791:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96242d067000 10000000:01000000:1.0:1790391461.451755:0:15791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790391461.451766:0:15791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790391461.451769:0:15791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391461.451774:0:15791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790391461.451778:0:15791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790391461.451833:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449b97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.451845:0:15791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449b97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.451859:0:15791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449b97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391461.451893:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391461.451989:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.452150:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.456371:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829824 00000100:00100000:0.0:1790391461.456395:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829824 00000100:00100000:2.0:1790391461.456574:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391461.456589:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:15791:x1877361130829824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391461.456613:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391461.456651:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412f10c00/0x35e94fc15449b981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b97a expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.456701:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412f10c00/0x35e94fc15449b981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b97a expref: 17 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.456715:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412f10c00/0x35e94fc15449b981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b97a expref: 17 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.456726:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f10c00, rc 0) 00000100:00100000:2.0:1790391461.456838:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130829824:12345-0@lo:101:mount.lustre.0 Request processed in 252us (4848us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.456846:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790391461.456955:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391461.456979:0:15791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449b97a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b981 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.456991:0:15791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449b97a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b981 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391461.461125:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790391461.468555:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391461.469418:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790391461.469482:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790391461.469515:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790391461.469560:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790391461.469791:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790391461.469822:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790391461.469884:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790391461.469892:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790391461.470064:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391461.470159:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.470209:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.470346:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130829952 00000100:00100000:0.0:1790391461.470355:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130829952 00000100:00100000:0.0:1790391461.470429:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391461.470441:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130829952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391461.471059:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130829952:12345-0@lo:501:mount.lustre.0 Request processed in 616us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.471070:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391461.475041:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130829952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391461.475142:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391461.475391:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.475454:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391461.475561:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830080 00000100:00100000:2.0:1790391461.475571:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830080 00000100:00100000:2.0:1790391461.475652:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391461.475663:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130830080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391461.476192:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130830080:12345-0@lo:503:mount.lustre.0 Request processed in 528us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.476203:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790391461.477839:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830080:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790391461.479075:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391461.479174:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391461.479264:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.479447:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830208 00000100:00100000:1.0:1790391461.479455:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.479461:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830208 00000100:00100000:0.0:1790391461.479540:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790391461.479564:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130830208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391461.479958:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130830208:12345-0@lo:502:mount.lustre.0 Request processed in 395us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.479968:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790391461.480167:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391461.480850:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1790391461.481151:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1790391461.481190:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1790391461.481726:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1790391461.481774:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1790391461.481810:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790391461.484350:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790391461.484410:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790391461.484479:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1790391461.484550:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391461.484699:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.484786:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f20300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391461.484917:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830336 00000100:00100000:2.0:1790391461.484928:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830336 00000100:00100000:2.0:1790391461.484994:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790391461.485006:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130830336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391461.485317:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130830336:12345-0@lo:502:mount.lustre.0 Request processed in 313us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.485326:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391461.485456:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391461.485562:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1790391461.485575:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1790391461.491283:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391461.491303:0:15792:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790391461.491312:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391461.491315:0:15792:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790391461.491325:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391461.491347:0:15792:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff962427f0cd40) 00000020:00000080:2.0:1790391461.491380:0:15792:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790391461.491388:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790391461.492367:0:15792:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96242d067000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790391461.492382:0:15792:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790391461.492393:0:15792:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x35e94fc15449b98f 00010000:00010000:2.0:1790391461.502822:0:15792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1790391461.505742:0:15792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1790391461.509814:0:15792:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790391461.523804:0:15792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790391461.523824:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391461.523833:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391461.523836:0:15792:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790391461.523843:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391461.523848:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391461.523850:0:15792:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391461.523854:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391461.523856:0:15792:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391461.523859:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391461.523861:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391461.523870:0:15792:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790391461.523873:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391461.523876:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391461.523877:0:15792:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391461.523881:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790391461.523973:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391461.523978:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391461.523979:0:15792:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391461.523982:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1790391461.525919:0:15791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1790391461.525983:0:15791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790391461.526005:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449b97a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b981 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.526046:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31600/0x35e94fc15449b97a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b981 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391461.526057:0:15791:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96242d067000 from 1 10000000:01000000:0.0:1790391461.526061:0:15791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391461.526124:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.526133:0:15791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.526161:0:15791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391461.526196:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391461.526372:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391461.527771:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830464 00000100:00100000:2.0:1790391461.527784:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830464 00000100:00100000:2.0:1790391461.527858:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391461.527870:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:15791:x1877361130830464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391461.527891:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391461.527912:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b996 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.527948:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b996 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.527960:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b996 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.527971:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962412f11a00, rc 0) 00000100:00100000:2.0:1790391461.528064:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830464:12345-0@lo:101:mount.lustre.0 Request processed in 194us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.528072:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790391461.529160:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624080f80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.529206:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391461.529244:0:15791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.529259:0:15791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391461.530902:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790391461.535845:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391461.539884:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790391461.540039:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790391461.540167:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790391461.540178:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790391461.541087:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391461.541180:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.541241:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624080f80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391461.541496:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830592 00000100:00100000:3.0:1790391461.541507:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830592 00000100:00100000:3.0:1790391461.541580:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790391461.541592:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391461.541937:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830592:12345-0@lo:501:mount.lustre.0 Request processed in 346us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391461.541956:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790391461.542225:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391461.542288:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391461.542334:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.542360:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391461.542496:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830720 00000100:00100000:3.0:1790391461.542502:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830720 00000100:00100000:3.0:1790391461.542537:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790391461.542545:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391461.542876:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830720:12345-0@lo:503:mount.lustre.0 Request processed in 331us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391461.542883:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790391461.543141:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790391461.543914:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391461.544057:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391461.544121:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.544155:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.544249:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830848 00000100:00100000:0.0:1790391461.544257:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830848 00000100:00100000:0.0:1790391461.544302:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790391461.544311:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391461.544539:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830848:12345-0@lo:502:mount.lustre.0 Request processed in 228us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.544552:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790391461.545848:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391461.546853:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790391461.546934:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790391461.546978:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790391461.547007:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790391461.547067:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790391461.547114:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790391461.547170:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790391461.547203:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790391461.547577:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391461.547762:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.547829:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391461.548889:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130830976 00000100:00100000:3.0:1790391461.548902:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130830976 00000100:00100000:3.0:1790391461.548980:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391461.548992:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391461.549786:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130830976:12345-0@lo:502:mount.lustre.0 Request processed in 790us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391461.549797:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790391461.550399:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130830976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391461.550799:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790391461.550819:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1790391461.556150:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391461.556171:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391461.556174:0:15796:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790391461.556188:0:15796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96242d067000 00000020:00000080:3.0:1790391461.556191:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391461.556201:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391461.556204:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391461.556205:0:15796:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790391461.556208:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391461.556210:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391461.556212:0:15796:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790391461.556215:0:15796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96242d067000 00000020:00000080:3.0:1790391461.556217:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391461.556314:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391461.556318:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391461.556319:0:15796:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790391461.556323:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391461.556326:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391461.556328:0:15796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391461.556332:0:15796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96242d067000 00000020:00000080:3.0:1790391461.556334:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391461.556376:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391461.556379:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391461.556381:0:15796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790391461.556386:0:15796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1790391461.562393:0:15791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1790391461.562614:0:15791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391461.562712:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.562740:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391461.562806:0:15791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790391461.562810:0:15791:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96242d067000 10000000:01000000:1.0:1790391461.562813:0:15791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96242d067000 10000000:01000000:1.0:1790391461.562819:0:15791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391461.562826:0:15791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96242d067000 from 1 10000000:01000000:1.0:1790391461.562830:0:15791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391461.562885:0:15791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30c00/0x35e94fc15449b9a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.562894:0:15791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e30c00/0x35e94fc15449b9a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.562908:0:15791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e30c00/0x35e94fc15449b9a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391461.562942:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391461.565781:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.566512:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391461.578456:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130831104 00000100:00100000:3.0:1790391461.578477:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130831104 00000100:00100000:3.0:1790391461.578561:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391461.578573:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130831104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391461.578595:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391461.578620:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e2200/0x35e94fc15449b9ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b9a4 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.579383:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e2200/0x35e94fc15449b9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b9a4 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.579399:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e2200/0x35e94fc15449b9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b9a4 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.579411:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2200, rc 0) 00000100:00100000:3.0:1790391461.579597:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831104:12345-0@lo:101:mount.lustre.0 Request processed in 1024us (13825us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391461.579606:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391461.579738:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391461.579774:0:15791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e30c00/0x35e94fc15449b9a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b9ab expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.579786:0:15791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e30c00/0x35e94fc15449b9a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b9ab expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391461.583086:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790391461.588877:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391461.594161:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790391461.594313:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790391461.594352:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790391461.594397:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790391461.594444:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790391461.594498:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790391461.594536:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790391461.594569:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790391461.594620:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790391461.594667:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790391461.594703:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790391461.594749:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790391461.594782:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790391461.594815:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790391461.594896:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790391461.594929:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790391461.594962:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790391461.595010:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790391461.595082:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790391461.595115:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790391461.595163:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790391461.595197:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790391461.595229:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790391461.595276:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790391461.595325:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790391461.595361:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790391461.595414:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790391461.595451:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790391461.595487:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790391461.595554:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790391461.595608:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790391461.595661:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790391461.595697:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790391461.595748:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790391461.595782:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790391461.595826:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790391461.595860:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790391461.595972:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790391461.595982:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790391461.596163:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391461.596251:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391461.596314:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962442158e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.596659:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130831232 00000100:00100000:0.0:1790391461.596670:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130831232 00000100:00100000:0.0:1790391461.596730:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790391461.596742:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962403a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391461.597096:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962403a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831232:12345-0@lo:501:mount.lustre.0 Request processed in 355us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.597105:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391461.604145:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391461.608892:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391461.609041:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391461.609115:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962442158e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391461.609279:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130831360 00000100:00100000:1.0:1790391461.609291:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130831360 00000100:00100000:1.0:1790391461.609369:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391461.609382:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391461.609786:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242dba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831360:12345-0@lo:503:mount.lustre.0 Request processed in 407us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391461.609796:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391461.609898:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301247480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790391461.610726:0:15791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391461.610839:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391461.610904:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.610945:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391461.614379:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130831488 00000100:00100000:3.0:1790391461.614404:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130831488 00000100:00100000:3.0:1790391461.614635:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391461.614652:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391461.615170:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831488:12345-0@lo:502:mount.lustre.0 Request processed in 522us (4264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391461.615179:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790391461.618216:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391461.618665:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1790391461.618744:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1790391461.618779:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1790391461.618827:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1790391461.618866:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1790391461.618932:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1790391461.618974:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1790391461.619008:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1790391461.619092:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1790391461.619133:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1790391461.619172:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1790391461.619258:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1790391461.619300:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1790391461.619337:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1790391461.619406:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1790391461.619442:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1790391461.619478:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1790391461.619528:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1790391461.619564:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1790391461.619598:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1790391461.619682:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1790391461.619722:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1790391461.619760:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1790391461.619813:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1790391461.619852:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1790391461.619891:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1790391461.619945:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1790391461.619986:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1790391461.620057:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1790391461.620114:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1790391461.620172:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1790391461.620211:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1790391461.620249:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1790391461.620300:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1790391461.620338:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1790391461.620387:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1790391461.620422:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1790391461.620455:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1790391461.620520:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1790391461.620561:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1790391461.620649:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391461.620761:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.620825:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391461.621375:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130831616 00000100:00100000:3.0:1790391461.621386:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130831616 00000100:00100000:3.0:1790391461.621455:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391461.621466:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391461.621794:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130831616:12345-0@lo:502:mount.lustre.0 Request processed in 328us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391461.621803:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790391461.626844:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130831616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391461.627100:0:15791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1790391461.627121:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790391461.633583:0:15801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790391461.633613:0:15801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff962427f40000) 00000020:00000080:3.0:1790391461.633657:0:15801:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1790391461.633749:0:15801:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96242d067000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790391461.633760:0:15801:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96242d067000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790391461.633763:0:15801:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96242d067000 3 00010000:00080000:3.0:1790391461.633820:0:15801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9623025ae800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.108@tcp at head 00010000:00010000:3.0:1790391461.639829:0:15801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1790391461.640102:0:15801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790391461.640154:0:15801:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790391461.640174:0:15801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x35e94fc15449b9b9 00000100:00080000:3.0:1790391461.640572:0:15801:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391461.640582:0:15801:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9623025ae800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:3.0:1790391461.640649:0:15801:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962301244000 x1877361130831744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391461.640679:0:15801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790391461.641783:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130831744:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391461.641886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.642110:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130831744 00000100:00100000:1.0:1790391461.642120:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130831744 00000100:00100000:1.0:1790391461.642165:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391461.642174:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1877361130831744:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790391461.642205:0:14391:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:1.0:1790391461.642267:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x35e94fc15449b9c0 00000004:00100000:1.0:1790391461.642285:0:14391:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790391461.642327:0:14391:0:(import.c:65:import_set_state_nolock()) ffff962411e31000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391461.642383:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1877361130831744:12345-0@lo:38:llog_process_th.0 Request processed in 209us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391461.642391:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790391461.642439:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962301244000 x1877361130831744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391461.642451:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391461.642462:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790391461.642471:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790391461.642476:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790391461.642479:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9623025ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790391461.642485:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1877361130831744:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790391461.642749:0:12654:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391461.642755:0:12654:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391461.642759:0:12654:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391461.642764:0:12654:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:0.0:1790391461.642776:0:12654:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790391461.642782:0:12654:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962407ac7800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391461.642803:0:12654:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439c71880 x1877361130832000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391461.642857:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391461.642869:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130831872:0@lo:400:kworker.0 00000100:00100000:0.0:1790391461.642912:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.642945:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130832128:0@lo:400:kworker.0 00000100:00100000:0.0:1790391461.642971:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.642990:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391461.642995:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130832256:0@lo:400:kworker.0 00000100:00100000:0.0:1790391461.643040:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.643082:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130831872 00000100:00100000:0.0:1790391461.643087:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130831872 00000100:00100000:0.0:1790391461.643143:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391461.643153:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130831872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391461.643196:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130831872:12345-0@lo:400:kworker.0 Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.643202:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391461.643222:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832128 00000100:00100000:0.0:1790391461.643225:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832128 00000100:00100000:0.0:1790391461.644416:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832256 00000100:00100000:0.0:1790391461.644425:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832256 00000100:00100000:0.0:1790391461.644449:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391461.644458:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130832128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391461.644540:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130832128:12345-0@lo:400:kworker.0 Request processed in 84us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.644558:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391461.644574:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391461.644580:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130832256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391461.644639:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877361130832256:12345-0@lo:400:kworker.0 Request processed in 47us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.644645:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790391461.644671:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391461.644677:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391461.644726:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130831872:0@lo:400:kworker.0 00010000:00080000:0.0:1790391461.644769:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962439c71180 x1877361130832256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391461.644780:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1877361130832256:0@lo:400:kworker.0 00010000:00080000:0.0:1790391461.644790:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962439c72300 x1877361130832128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391461.644798:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130832128:0@lo:400:kworker.0 00000100:00100000:0.0:1790391461.644820:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130832000:0@lo:8:kworker.0 00000040:00080000:1.0:1790391461.645391:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1790391461.645537:0:15791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790391461.645570:0:15791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391461.645585:0:15791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e30c00/0x35e94fc15449b9a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b9ab expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.645596:0:15791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e30c00/0x35e94fc15449b9a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b9ab expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790391461.645780:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790391461.645783:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790391461.645785:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391461.645786:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391461.645788:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391461.645789:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391461.645791:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391461.645794:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391461.645796:0:15791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391461.645800:0:15791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790391461.646326:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391461.646327:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790391461.646328:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391461.646330:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391461.646331:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391461.646332:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391461.646333:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391461.646334:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391461.646336:0:15791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391461.646367:0:15791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790391461.646388:0:15791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130832384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790391461.646459:0:15791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391461.646505:0:15791:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c26840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391461.647426:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.647499:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832000 00000100:00100000:0.0:1790391461.647508:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832000 00000100:00100000:0.0:1790391461.647549:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391461.647558:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1877361130832000:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790391461.647642:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1877361130832000:12345-0@lo:8:kworker.0 Request processed in 70us (204us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790391461.647650:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391461.647711:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391461.647721:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391461.647725:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790391461.647729:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130832000:0@lo:8:kworker.0 00000100:00100000:3.0:1790391461.647900:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832384 00000100:00100000:3.0:1790391461.647905:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832384 00000100:00100000:3.0:1790391461.647948:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391461.647965:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:15791:x1877361130832384:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790391461.647997:0:14385:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790391461.648042:0:14385:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790391461.708327:0:14385:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790391461.708388:0:14385:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790391461.708489:0:14406:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790391461.708496:0:14406:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790391461.708529:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.708554:0:14406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b89a expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.708566:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.708638:0:14406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449b89a expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.708656:0:14406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449b89a expref: 19 pid: 14384 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391461.708675:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1877361130832512:0@lo:104: 00000100:00100000:0.0:1790391461.708770:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.708848:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff96242db7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391461.708930:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832512 00000100:00100000:2.0:1790391461.708940:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832512 00000100:00100000:2.0:1790391461.709056:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391461.709069:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14406:x1877361130832512:12345-0@lo:104: 00010000:00010000:2.0:1790391461.709086:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709154:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391461.709161:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:14406:x1877361130832512:12345-0@lo:104: Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.709169:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790391461.709198:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391461.709206:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709214:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1790391461.709220:0:14379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709243:0:14379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391461.709252:0:14379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391461.709259:0:14379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391461.709291:0:14379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709298:0:14379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391461.709323:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709343:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff962412f11000/0x35e94fc15449b89a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b8a1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709363:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391461.709365:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391461.709367:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391461.709391:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130832640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391461.709424:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391461.709474:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832640 00000100:00100000:2.0:1790391461.709478:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832640 00010000:00010000:2.0:1790391461.709496:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b89a expref: 20 pid: 14384 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391461.709517:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391461.709524:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+20:3307:x1877361130832640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391461.709535:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391461.709539:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b89a expref: 20 pid: 14384 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709550:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449b89a expref: 20 pid: 14384 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709569:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709580:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790391461.709594:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003962124s 00010000:00010000:2.0:1790391461.709605:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709614:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709622:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709643:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709648:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391461.709654:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709662:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709671:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.709683:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391461.709713:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+20:3307:x1877361130832640:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.709721:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391461.709765:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130832640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391461.710128:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3c00/0x35e94fc15449b8a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449b89a expref: 19 pid: 14384 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391461.710157:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14406:1877361130832512:0@lo:104: 00010000:00010000:1.0:1790391461.710175:0:14406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.710185:0:14406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.710193:0:14406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.710200:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96240e979800/0x35e94fc15449b9c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391461.718446:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:15791:x1877361130832384:12345-0@lo:253:mount.lustre.0 Request processed in 70475us (71972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.718476:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391461.718745:0:15791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bbc90112-ffb7-4b19-a960-3ef7f783602e:15791:1877361130832384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790391461.718767:0:15791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790391461.718772:0:15791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391461.718773:0:15791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790391461.718775:0:15791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391461.718776:0:15791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391461.718778:0:15791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391461.718779:0:15791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391461.718780:0:15791:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391461.718783:0:15791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391461.718784:0:15791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790391461.718812:0:15791:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790391461.724207:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391461.724538:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790391461.724729:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391461.724888:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790391461.725172:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1790391461.725572:0:15791:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790391461.726936:0:15791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1790391461.823769:0:15791:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790391461.823783:0:15791:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790391461.823836:0:15791:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790391461.823929:0:15791:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.108@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790391461.823948:0:15791:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790391461.823992:0:15791:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790391461.985965:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391463.001357:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790391463.193283:0:14387:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790391463.193295:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962411e7e800 from 8 10000000:01000000:2.0:1790391463.193302:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391463.193373:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412f10200/0x35e94fc15449b9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.193388:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962412f10200/0x35e94fc15449b9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.193402:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962412f10200/0x35e94fc15449b9ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.193441:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130832768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391463.193538:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391463.193636:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391463.194450:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832768 00000100:00100000:0.0:1790391463.194482:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832768 00000100:00100000:0.0:1790391463.194558:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790391463.194569:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:14387:x1877361130832768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391463.194588:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391463.194621:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e978c00/0x35e94fc15449b9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449b9ce expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.194658:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e978c00/0x35e94fc15449b9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449b9ce expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.194672:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e978c00/0x35e94fc15449b9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b9ce expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.194684:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978c00, rc 0) 00000100:00100000:0.0:1790391463.194937:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130832768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 369us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391463.194945:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790391463.195064:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130832768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391463.195085:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962412f10200/0x35e94fc15449b9ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b9d5 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.195095:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962412f10200/0x35e94fc15449b9ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449b9d5 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.195168:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130832896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790391463.195230:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391463.195274:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624031fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391463.195402:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130832896 00000100:00100000:0.0:1790391463.195408:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130832896 00000100:00100000:0.0:1790391463.195492:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790391463.195502:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130832896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790391463.195521:0:14385:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391463.195543:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391463.195547:0:14385:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790391463.195662:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130832896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391463.195670:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790391463.195751:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130832896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790391463.195825:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391463.195835:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962412f10200/0x35e94fc15449b9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b9d5 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.195845:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962412f10200/0x35e94fc15449b9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449b9d5 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391464.026876:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391464.346267:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130833024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391464.346370:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391464.348391:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833024 00000100:00100000:3.0:1790391464.348414:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833024 00000100:00100000:3.0:1790391464.348511:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391464.348525:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130833024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391464.348578:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391464.348701:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130833024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391464.348710:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391464.348964:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130833024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790391464.350041:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391465.050596:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391466.084082:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391466.905265:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391466.905690:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391466.905712:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130833280:0@lo:400:kworker.0 00000100:00100000:1.0:1790391466.905784:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391466.906005:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833280 00000100:00100000:1.0:1790391466.906012:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833280 00000100:00100000:1.0:1790391466.906087:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391466.906097:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130833280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391466.906149:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130833280:12345-0@lo:400:kworker.0 Request processed in 54us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391466.906156:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790391466.906178:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391466.906465:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130833280:0@lo:400:kworker.0 00000100:00100000:2.0:1790391466.908681:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbc90112-ffb7-4b19-a960-3ef7f783602e:3310:1877361130833152:0@lo:400:kworker.0 00000100:00100000:2.0:1790391466.908754:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391466.909089:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833152 00000100:00100000:1.0:1790391466.909099:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833152 00000100:00100000:1.0:1790391466.909150:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790391466.909158:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3310:x1877361130833152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391466.909215:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3310:x1877361130833152:12345-0@lo:400:kworker.0 Request processed in 57us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391466.909222:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391466.909851:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbc90112-ffb7-4b19-a960-3ef7f783602e:3310:1877361130833152:0@lo:400:kworker.0 00000100:00080000:0.0:1790391466.911979:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391466.912000:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391466.912004:0:8:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391466.912027:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962407ac7800 using connection 192.168.201.108@tcp/0@lo 00000100:00100000:0.0:1790391466.912063:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962439c71880 x1877361130833408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391466.912136:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130833408:0@lo:8:kworker.0 00000100:00100000:0.0:1790391466.912213:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391466.912260:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130833536:0@lo:400:kworker.0 00000100:00100000:0.0:1790391466.912288:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391466.912307:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391466.912312:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130833664:0@lo:400:kworker.0 00000100:00100000:0.0:1790391466.912330:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391466.912358:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833408 00000100:00100000:0.0:1790391466.912365:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833408 00000100:00100000:0.0:1790391466.912399:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391466.912406:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1877361130833408:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790391466.912436:0:15074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1790391466.912476:0:15074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x35e94fc15449b9dc 00002000:00100000:0.0:1790391466.912491:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff962302581000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790391466.912495:0:15074:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790391466.912498:0:15074:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790391466.914896:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790391466.914931:0:15074:0:(import.c:65:import_set_state_nolock()) ffff962302587000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391466.915035:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1877361130833408:12345-0@lo:8:kworker.0 Request processed in 2625us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391466.915056:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391466.915098:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833536 00000100:00100000:0.0:1790391466.915105:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833536 00000100:00100000:0.0:1790391466.915139:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833664 00000100:00100000:0.0:1790391466.915142:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833664 00000100:00100000:0.0:1790391466.915168:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391466.915175:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130833536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391466.915217:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130833536:12345-0@lo:400:kworker.0 Request processed in 42us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391466.915224:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391466.915236:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391466.915243:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130833664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391466.915270:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130833664:12345-0@lo:400:kworker.0 Request processed in 28us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391466.915275:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790391466.915320:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439c71880 x1877361130833408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790391466.915337:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790391466.915345:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790391466.915351:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790391466.915353:0:3306:0:(import.c:65:import_set_state_nolock()) ffff962407ac7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790391466.915374:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790391466.915380:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1877361130833408:0@lo:8:kworker.0 00000100:00080000:0.0:1790391466.915411:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790391466.915430:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439c73480 x1877361130833664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391466.915452:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130833664:0@lo:400:kworker.0 00010000:00080000:0.0:1790391466.915466:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439c70700 x1877361130833536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391466.915473:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130833536:0@lo:400:kworker.0 00000100:00100000:0.0:1790391466.916667:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130833792:0@lo:400:kworker.0 00000100:00100000:0.0:1790391466.916724:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391466.916770:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833792 00000100:00100000:0.0:1790391466.916776:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833792 00000100:00100000:0.0:1790391466.916819:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391466.916827:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130833792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391466.916870:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130833792:12345-0@lo:400:kworker.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391466.916877:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790391466.916895:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790391466.916918:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439c72a00 x1877361130833792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391466.916929:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130833792:0@lo:400:kworker.0 00000100:00100000:1.0:1790391466.917320:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1790391466.919572:0:14415:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1790391466.919635:0:14415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1877361130834048:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790391466.919704:0:14415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391466.919740:0:14415:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241be06000 going to sleep for 11 seconds 00000004:00080000:2.0:1790391466.919771:0:14414:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790391466.920240:0:14414:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 502254224079ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790391466.920296:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834048 00000100:00100000:2.0:1790391466.920304:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834048 00000100:00100000:2.0:1790391466.920359:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391466.920369:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14415:x1877361130834048:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1790391466.922265:0:15498:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790391466.922278:0:15498:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1790391466.922283:0:15498:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1790391466.926047:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130833920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391466.926139:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391466.926264:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130833920 00000100:00100000:0.0:1790391466.926274:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130833920 00000100:00100000:0.0:1790391466.926329:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391466.926338:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877361130833920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391466.926378:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391466.926428:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877361130833920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391466.926442:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790391466.926571:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962439727100 x1877361130833920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391466.926668:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130833920:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790391466.934049:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1790391466.934967:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.934977:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.934992:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.934996:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.935001:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935039:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935048:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935054:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935068:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391466.935078:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391466.935082:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935088:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391466.935092:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935104:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935117:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935122:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449b9e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.935137:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.935139:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.935569:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.936412:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.936420:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.936434:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.936437:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.936442:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.936453:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.936536:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.936565:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.936659:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.937114:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.937120:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.937130:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.937133:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.937138:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.937313:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391466.937319:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.937330:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391466.937334:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.937341:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.937359:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.937364:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449b9ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.937378:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391466.937380:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391466.937381:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.937444:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.937450:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.937456:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.937577:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.938121:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.938126:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.938136:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.938139:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.938201:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.938211:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.938219:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.938227:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.943000:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391466.943027:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.943043:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391466.943048:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.943062:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.943090:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.943099:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449b9f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.947501:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391466.947684:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391466.947693:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.947707:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391466.947712:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.947723:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.947751:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.947758:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449b9f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.947779:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391466.947781:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391466.947783:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.947918:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.947922:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.947924:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.949285:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.949295:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949309:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.949314:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.949320:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949334:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949355:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949364:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949382:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.949939:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.949946:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949955:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.949959:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.949963:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949973:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949982:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.949991:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.950173:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790391466.951827:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.951840:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.951856:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.951860:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.951867:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.951879:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.951889:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.951898:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952150:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790391466.952158:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952165:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391466.952170:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952179:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952195:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952203:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449b9ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952239:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391466.952244:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952250:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391466.952253:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952261:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952271:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952278:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952289:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391466.952292:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952298:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391466.952301:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952318:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952327:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.952334:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391466.952336:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391466.952338:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.955713:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.955805:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790391466.955818:0:15498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.956710:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.956793:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.956802:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.956821:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.956826:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.956832:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.956846:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.956856:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.956863:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.956885:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.957366:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.957372:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.957381:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.957384:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.957388:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.957397:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.957417:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.957424:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.957436:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790391466.957577:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391466.957594:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957603:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391466.957608:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957619:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957636:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957644:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957662:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391466.957665:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957671:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391466.957674:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957681:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957703:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957710:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.957723:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.957725:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.957726:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.957733:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.960296:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.960313:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.960332:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.960337:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.960345:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.960361:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.960372:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.960382:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.960454:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.961143:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.961151:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.961161:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.961164:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.961168:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.961178:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.961186:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.961192:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964683:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391466.964697:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964711:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391466.964717:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964729:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964751:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964759:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964794:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391466.964798:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964805:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391466.964809:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964816:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964826:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.964832:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.964834:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.964835:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.970719:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790391466.970734:0:15498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.970816:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.971449:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.973572:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.973609:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.973614:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.973620:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.973640:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.973652:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.973661:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.973694:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.974324:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.974331:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974341:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.974345:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.974349:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974358:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974375:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974381:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974397:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790391466.974411:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391466.974416:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974424:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391466.974428:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974437:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974454:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974476:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2025542/0x35e94fc15449ba30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974498:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391466.974507:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974513:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391466.974516:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974524:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974534:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974551:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000498e78b5/0x35e94fc15449ba37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.974565:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.974566:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.974568:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.974991:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.974997:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975006:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.975009:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.975036:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975057:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975066:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975073:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975090:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391466.975099:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391466.975102:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975109:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391466.975112:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975120:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975131:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975138:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb90d271/0x35e94fc15449ba3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.975158:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.975160:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.975161:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.976263:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.979378:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.979394:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.979411:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.979415:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.979421:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.979436:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.979445:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.979452:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.981572:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391466.981664:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391466.981671:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.981696:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391466.981701:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.981712:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.981733:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.981741:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f53a51/0x35e94fc15449ba45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.981765:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.981766:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.981768:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.983640:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.983653:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.983668:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.983673:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.983679:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.983692:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.983709:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.983718:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.983735:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.986837:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.986852:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986868:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.986873:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.986879:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986893:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986902:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986910:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986939:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790391466.986952:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391466.986958:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986965:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391466.986970:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986979:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.986994:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.987002:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b53d5fd/0x35e94fc15449ba4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.987042:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391466.987046:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.987052:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391466.987055:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.987074:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.987085:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.987093:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be3c1bff/0x35e94fc15449ba53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.987106:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.987107:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391466.987109:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.987341:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.990066:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.990078:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.990096:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.990101:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.990108:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.990123:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.990134:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.990160:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.990182:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391466.991734:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391466.991745:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.991756:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391466.991761:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.991787:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.991808:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.991815:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003909881c/0x35e94fc15449ba5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.991838:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.991840:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391466.991841:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391466.994050:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.994063:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.994081:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.994086:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.994093:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.994108:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.994118:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.994126:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.994155:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391466.995904:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.995915:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.995934:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.995938:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.995944:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.995957:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.995967:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.995974:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.995993:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790391466.996446:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.996452:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.996472:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.996475:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.996480:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.996489:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.996508:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.996515:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.996524:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790391466.999409:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.999421:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999437:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.999441:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.999447:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999472:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999483:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999490:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999510:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1790391466.999880:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391466.999886:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999894:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391466.999897:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391466.999901:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999909:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999916:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999923:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391466.999931:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1790391467.000825:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391467.000832:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.000842:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391467.000852:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391467.000856:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.000867:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.000875:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.000882:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.000890:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1790391467.001548:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790391467.001558:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001567:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.001572:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001582:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001599:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001620:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084525d9f/0x35e94fc15449ba61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001642:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790391467.001646:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001653:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.001656:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001663:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001674:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001682:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9b5cfab/0x35e94fc15449ba68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001694:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790391467.001697:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001703:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f11e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.001711:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001719:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001728:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001735:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1442651/0x35e94fc15449ba6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001746:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790391467.001749:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001756:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.001758:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001766:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001774:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001781:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c708dc7f/0x35e94fc15449ba76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001799:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391467.001804:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001811:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962412f10000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.001814:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001822:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001832:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001839:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a684246/0x35e94fc15449ba7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001849:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391467.001852:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001857:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.001860:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001876:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001885:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001892:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010d0a4f8/0x35e94fc15449ba84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.001904:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.001905:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.001907:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.001913:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391467.005784:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391467.005799:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.005816:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391467.005820:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391467.005826:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.005841:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.005851:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.005863:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.005882:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391467.006637:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391467.006646:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.006668:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0000 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.006673:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.006683:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.006700:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.006719:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010dbc02a/0x35e94fc15449ba8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.006742:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.006744:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.006746:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391467.007364:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391467.007373:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.007385:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391467.007389:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391467.007394:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.007405:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.007414:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.007421:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.007441:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391467.007606:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391467.007613:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.007620:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.007624:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.007632:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.007645:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.007975:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fc20a95/0x35e94fc15449ba92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.007993:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.007995:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.007996:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391467.014319:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391467.014331:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.014356:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391467.014361:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391467.014367:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.014383:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.014394:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.014402:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.014421:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391467.015009:0:15498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790391467.015033:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.015041:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1790391467.015044:0:15498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391467.015049:0:15498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.015058:0:15498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.015077:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.015084:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391467.015098:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790391467.015411:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391467.015419:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015428:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.015432:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015440:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015456:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015464:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a125a98b/0x35e94fc15449ba99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015481:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391467.015485:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015491:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1800 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391467.015494:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015501:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015524:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015532:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef249bdb/0x35e94fc15449baa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391467.015557:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.015559:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.015561:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391467.015568:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1790391467.017462:0:15498:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1790391467.017616:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14415:x1877361130834048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 97244us (97907us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391467.017628:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391467.018271:0:14415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1877361130834048:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790391467.018288:0:14415:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1790391467.018426:0:14415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1877361130834176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790391467.018467:0:14415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391467.018501:0:14415:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624119cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391467.018514:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834176 00000100:00100000:0.0:1790391467.018519:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834176 00000100:00100000:0.0:1790391467.018568:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391467.018577:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14415:x1877361130834176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790391467.018615:0:15074:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1790391467.027061:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14415:x1877361130834176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8479us (8588us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790391467.027075:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391467.027082:0:14415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14415:1877361130834176:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790391467.027096:0:14415:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1790391467.031210:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1790391467.098114:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391468.121166:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391468.899965:0:16149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790391469.147075:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391469.465532:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130834304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391469.465609:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391469.465797:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834304 00000100:00100000:0.0:1790391469.465806:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834304 00000100:00100000:0.0:1790391469.465874:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391469.465885:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130834304:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391469.465899:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1790391469.465920:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391469.465973:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130834304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391469.465979:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391469.466733:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130834304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391470.177849:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391470.558763:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391471.196332:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391471.239419:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.239505:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108820736 00000100:00100000:0.0:1790391471.239515:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108820736 00000100:00100000:0.0:1790391471.239561:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00100000:0.0:1790391471.239570:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2362:x1877361108820736:12345-192.168.201.8@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790391471.239598:0:14385:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8785f6fb-acab-4133-9d0f-dbdf7bea48cd@192.168.201.8@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1790391471.239628:0:14385:0:(genops.c:1385:class_connect()) connect: client 8785f6fb-acab-4133-9d0f-dbdf7bea48cd, cookie 0x35e94fc15449baa7 00000100:00080000:0.0:1790391471.239766:0:14385:0:(import.c:65:import_set_state_nolock()) ffff962302580000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391471.239842:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+5:2362:x1877361108820736:12345-192.168.201.8@tcp:250:mount.lustre.0 Request processed in 271us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.239850:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 76 00000100:00100000:3.0:1790391471.241993:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391471.242219:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108820864 00000100:00100000:1.0:1790391471.242229:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108820864 00000100:00100000:1.0:1790391471.242286:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:1.0:1790391471.242296:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+5:13767:x1877361108820864:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790391471.242312:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391471.242328:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e30400/0x35e94fc15449baae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20081 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391471.242354:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e30400/0x35e94fc15449baae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20081 expref: 6 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391471.242366:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e30400/0x35e94fc15449baae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20081 expref: 6 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391471.242391:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30400, rc 0) 00000100:00100000:1.0:1790391471.242446:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+6:13767:x1877361108820864:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 152us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391471.242453:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 77 00000100:00100000:2.0:1790391471.245839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391471.245917:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108820992 00000100:00100000:1.0:1790391471.245927:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108820992 00000100:00100000:1.0:1790391471.245989:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:1.0:1790391471.245999:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+6:13767:x1877361108820992:12345-192.168.201.8@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790391471.246579:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+6:13767:x1877361108820992:12345-192.168.201.8@tcp:501:mount.lustre.0 Request processed in 578us (745us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391471.246588:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 78 00000100:00100000:3.0:1790391471.250709:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.251679:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108821120 00000100:00100000:0.0:1790391471.251692:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108821120 00000100:00100000:0.0:1790391471.251798:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 79 00000100:00100000:0.0:1790391471.251810:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+6:13767:x1877361108821120:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391471.251842:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391471.251861:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e978400/0x35e94fc15449bab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20088 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.251890:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e978400/0x35e94fc15449bab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20088 expref: 7 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.251903:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e978400/0x35e94fc15449bab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20088 expref: 7 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.251914:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978400, rc 0) 00000100:00100000:0.0:1790391471.252000:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+7:13767:x1877361108821120:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 191us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.252007:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 79 00000100:00100000:3.0:1790391471.261609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391471.261706:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108821248 00000100:00100000:1.0:1790391471.261717:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108821248 00000100:00100000:1.0:1790391471.261773:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 80 00000100:00100000:1.0:1790391471.261794:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+7:13767:x1877361108821248:12345-192.168.201.8@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790391471.262162:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13767:x1877361108821248:12345-192.168.201.8@tcp:501:mount.lustre.0 Request processed in 379us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391471.262171:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 80 00000100:00100000:3.0:1790391471.268402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.268496:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108821376 00000100:00100000:0.0:1790391471.268506:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108821376 00000100:00100000:0.0:1790391471.268564:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 81 00000100:00100000:0.0:1790391471.268575:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13767:x1877361108821376:12345-192.168.201.8@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790391471.268895:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13767:x1877361108821376:12345-192.168.201.8@tcp:503:mount.lustre.0 Request processed in 320us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.268904:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 81 00000100:00100000:3.0:1790391471.273380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391471.273491:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108821504 00000100:00100000:2.0:1790391471.273502:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108821504 00000100:00100000:2.0:1790391471.273555:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:2.0:1790391471.273565:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13785:x1877361108821504:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391471.273913:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13785:x1877361108821504:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 348us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391471.273921:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 82 00000100:00100000:3.0:1790391471.298448:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391471.298582:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108821632 00000100:00100000:1.0:1790391471.298592:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108821632 00000100:00100000:1.0:1790391471.298652:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 83 00000100:00100000:1.0:1790391471.298662:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13785:x1877361108821632:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391471.299201:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13785:x1877361108821632:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 537us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391471.299218:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 83 00000100:00100000:1.0:1790391471.305122:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.314900:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108821760 00000100:00100000:0.0:1790391471.314929:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108821760 00000100:00100000:0.0:1790391471.315007:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 84 00000100:00100000:0.0:1790391471.315064:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+8:13767:x1877361108821760:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391471.315081:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391471.315115:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e979a00/0x35e94fc15449babc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f200b2 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.315145:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e979a00/0x35e94fc15449babc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b2 expref: 9 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.315157:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e979a00/0x35e94fc15449babc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b2 expref: 9 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.315167:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979a00, rc 0) 00000100:00100000:0.0:1790391471.315235:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+9:13767:x1877361108821760:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 219us (10124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.315243:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 84 00000100:00100000:3.0:1790391471.318122:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391471.318277:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108821888 00000100:00100000:2.0:1790391471.318302:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108821888 00000100:00100000:2.0:1790391471.318363:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 85 00000100:00100000:2.0:1790391471.318373:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+9:13767:x1877361108821888:12345-192.168.201.8@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790391471.318399:0:14382:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790391471.318417:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790391471.318421:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790391471.318424:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790391471.318426:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790391471.324570:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a3b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+9:13767:x1877361108821888:12345-192.168.201.8@tcp:256:mount.lustre.0 Request processed in 6182us (6444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391471.324586:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 85 00000100:00100000:1.0:1790391471.327857:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.334170:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822016 00000100:00100000:0.0:1790391471.334188:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822016 00000100:00100000:0.0:1790391471.334341:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 86 00000100:00100000:0.0:1790391471.334353:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+9:13767:x1877361108822016:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391471.334369:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391471.334388:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f200b9 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.334418:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 10 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.334430:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 10 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.334439:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979200, rc 0) 00000100:00100000:0.0:1790391471.334525:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13767:x1877361108822016:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 174us (6677us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.334546:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 86 00000100:00100000:3.0:1790391471.338405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391471.343361:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822144 00000100:00100000:2.0:1790391471.343377:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822144 00000100:00100000:2.0:1790391471.343435:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 87 00000100:00100000:2.0:1790391471.343445:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13767:x1877361108822144:12345-192.168.201.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790391471.344042:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13767:x1877361108822144:12345-192.168.201.8@tcp:501:mount.lustre.0 Request processed in 596us (5645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391471.344052:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 87 00000100:00100000:3.0:1790391471.346052:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391471.346222:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822272 00000100:00100000:2.0:1790391471.346232:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822272 00000100:00100000:2.0:1790391471.346284:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00100000:2.0:1790391471.346294:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13767:x1877361108822272:12345-192.168.201.8@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790391471.346682:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13767:x1877361108822272:12345-192.168.201.8@tcp:503:mount.lustre.0 Request processed in 388us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391471.346690:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 88 00000100:00100000:2.0:1790391471.349842:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391471.350087:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822400 00000100:00100000:1.0:1790391471.350098:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822400 00000100:00100000:1.0:1790391471.350150:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 89 00000100:00100000:1.0:1790391471.350159:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13787:x1877361108822400:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391471.350421:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13787:x1877361108822400:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 262us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391471.350430:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 89 00000100:00100000:3.0:1790391471.355138:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.355366:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822528 00000100:00100000:0.0:1790391471.355379:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822528 00000100:00100000:0.0:1790391471.355448:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 90 00000100:00100000:0.0:1790391471.355462:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13787:x1877361108822528:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391471.357432:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13787:x1877361108822528:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 1964us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.357444:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 90 00000100:00100000:3.0:1790391471.377644:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.377975:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822656 00000100:00100000:0.0:1790391471.377984:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822656 00000100:00100000:0.0:1790391471.378084:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:0.0:1790391471.378095:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2362:x1877361108822656:12345-192.168.201.8@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790391471.378125:0:14391:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from acc7d8d9-5ca3-4792-891a-4d69befb1442@192.168.201.8@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1790391471.378174:0:14391:0:(genops.c:1385:class_connect()) connect: client acc7d8d9-5ca3-4792-891a-4d69befb1442, cookie 0x35e94fc15449baca 00000004:00100000:0.0:1790391471.378205:0:14391:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1790391471.378211:0:14391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1790391471.414297:0:14391:0:(import.c:65:import_set_state_nolock()) ffff962411e31800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391471.414384:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2362:x1877361108822656:12345-192.168.201.8@tcp:38:mount.lustre.0 Request processed in 36289us (36750us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391471.414396:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:3.0:1790391471.417774:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391471.417805:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.417873:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822912 00000100:00100000:0.0:1790391471.417885:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822912 00000100:00100000:2.0:1790391471.417988:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108822784 00000100:00100000:2.0:1790391471.417993:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108822784 00000100:00100000:0.0:1790391471.418141:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1790391471.418175:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:13767:x1877361108822912:12345-192.168.201.8@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391471.418218:0:14390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790391471.418310:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:13767:x1877361108822912:12345-192.168.201.8@tcp:41:mount.lustre.0 Request processed in 138us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.422592:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1790391471.422659:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:0.0:1790391471.422674:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:0:x1877361108822784:12345-192.168.201.8@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391471.422707:0:14390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790391471.422770:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:0:x1877361108822784:12345-192.168.201.8@tcp:41:mount.lustre.0 Request processed in 103us (4964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.422778:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00080000:3.0:1790391471.423229:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391471.425687:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.426389:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823040 00000100:00100000:0.0:1790391471.426400:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823040 00000100:00100000:0.0:1790391471.426449:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1790391471.426460:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:13767:x1877361108823040:12345-192.168.201.8@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790391471.426571:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:13767:x1877361108823040:12345-192.168.201.8@tcp:40:mount.lustre.0 Request processed in 112us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.426579:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:2.0:1790391471.430331:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391471.430379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391471.430408:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391471.430436:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823168 00000100:00100000:2.0:1790391471.430445:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823168 00000100:00100000:2.0:1790391471.430488:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823296 00000100:00100000:2.0:1790391471.430492:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823296 00000100:00100000:2.0:1790391471.430511:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:2.0:1790391471.430520:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2362:x1877361108823168:12345-192.168.201.8@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790391471.430555:0:15498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from acc7d8d9-5ca3-4792-891a-4d69befb1442@192.168.201.8@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1790391471.430590:0:15498:0:(genops.c:1385:class_connect()) connect: client acc7d8d9-5ca3-4792-891a-4d69befb1442, cookie 0x35e94fc15449bad1 00002000:00100000:2.0:1790391471.430603:0:15498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli acc7d8d9-5ca3-4792-891a-4d69befb1442/ffff96241ffc2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790391471.430632:0:15498:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790391471.430963:0:15498:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790391471.430993:0:15498:0:(import.c:65:import_set_state_nolock()) ffff96241ffc1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391471.431191:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823424 00000100:00100000:0.0:1790391471.431197:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823424 00000100:00100000:0.0:1790391471.431241:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:0.0:1790391471.431250:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:13767:x1877361108823424:12345-192.168.201.8@tcp:33:mount.lustre.0 00000100:00100000:0.0:1790391471.431411:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1790391471.431417:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1877361108823296:12345-192.168.201.8@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790391471.431435:0:15075:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from acc7d8d9-5ca3-4792-891a-4d69befb1442@192.168.201.8@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1790391471.431455:0:15075:0:(genops.c:1385:class_connect()) connect: client acc7d8d9-5ca3-4792-891a-4d69befb1442, cookie 0x35e94fc15449bad8 00002000:00100000:0.0:1790391471.431461:0:15075:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli acc7d8d9-5ca3-4792-891a-4d69befb1442/ffff962302584800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391471.431492:0:15075:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391471.431626:0:15075:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1790391471.431694:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2362:x1877361108823168:12345-192.168.201.8@tcp:8:mount.lustre.0 Request processed in 1172us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391471.431702:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000004:00080000:1.0:1790391471.433948:0:14393:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2561us 00000100:00080000:0.0:1790391471.436699:0:15075:0:(import.c:65:import_set_state_nolock()) ffff962302585800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391471.436780:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2362:x1877361108823296:12345-192.168.201.8@tcp:8:mount.lustre.0 Request processed in 5357us (6366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.436792:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000004:00200000:0.0:1790391471.450384:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790391471.450525:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:13767:x1877361108823424:12345-192.168.201.8@tcp:33:mount.lustre.0 Request processed in 19269us (20262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.450537:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391471.597207:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391471.597401:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823552 00000100:00100000:0.0:1790391471.597411:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823552 00000100:00100000:0.0:1790391471.597485:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:0.0:1790391471.597496:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:13808:x1877361108823552:12345-192.168.201.8@tcp:101:mkdir.0 00010000:00010000:0.0:1790391471.597516:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391471.597543:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449badf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f200e3 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.597613:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449bae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.597627:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449bae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.597643:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449bae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391471.597678:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790391471.597682:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391471.597720:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449bae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.597780:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979400/0x35e94fc15449badf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200e3 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.597799:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449bae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200e3 expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391471.597809:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:0.0:1790391471.597812:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391471.597816:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979800, rc 0) 00000100:00100000:0.0:1790391471.598000:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:13808:x1877361108823552:12345-192.168.201.8@tcp:101:mkdir.0 Request processed in 505us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.598008:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:3.0:1790391472.025360:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130834432:0@lo:400:kworker.0 00000100:00100000:0.0:1790391472.025360:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130834816:0@lo:400:kworker.0 00000100:00100000:1.0:1790391472.025493:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130834560:0@lo:400:kworker.0 00000100:00100000:2.0:1790391472.025578:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130834688:0@lo:400:kworker.0 00000100:00100000:3.0:1790391472.027572:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391472.028374:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130834944:0@lo:400:kworker.0 00000100:00100000:3.0:1790391472.028430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391472.037391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391472.037450:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834944 00000100:00100000:0.0:1790391472.037468:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834944 00000100:00100000:0.0:1790391472.037528:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834816 00000100:00100000:0.0:1790391472.037530:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834816 00000100:00100000:0.0:1790391472.037546:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391472.037555:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130834944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391472.037631:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877361130834944:12345-0@lo:400:kworker.0 Request processed in 77us (9200us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391472.037640:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391472.037657:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391472.037663:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130834816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391472.037692:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130834816:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391472.037705:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1790391472.037733:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391472.037785:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1877361130834944:0@lo:400:kworker.0 00000100:00100000:0.0:1790391472.037820:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130834816:0@lo:400:kworker.0 00000100:00100000:0.0:1790391472.038142:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834432 00000100:00100000:0.0:1790391472.038147:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834432 00000100:00100000:0.0:1790391472.038177:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790391472.038183:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3308:x1877361130834432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391472.038224:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3308:x1877361130834432:12345-0@lo:400:kworker.0 Request processed in 41us (10657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391472.038230:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790391472.038263:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130834432:0@lo:400:kworker.0 00000100:00100000:2.0:1790391472.048997:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391472.049069:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834688 00000100:00100000:2.0:1790391472.049078:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834688 00000100:00100000:2.0:1790391472.049223:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391472.049242:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130834688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391472.049246:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391472.049296:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130834560 00000100:00100000:2.0:1790391472.049297:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130834688:12345-0@lo:400:kworker.0 Request processed in 58us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391472.049300:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130834560 00000100:00100000:2.0:1790391472.049304:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391472.049318:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391472.049325:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130834560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391472.049341:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130835072:0@lo:400:kworker.0 00000100:00100000:2.0:1790391472.049352:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130834560:12345-0@lo:400:kworker.0 Request processed in 29us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391472.049357:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391472.049372:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391472.049373:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391472.049395:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835072 00000100:00100000:1.0:1790391472.049398:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835072 00000100:00100000:1.0:1790391472.049427:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391472.049434:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130835072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391472.049487:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130835072:12345-0@lo:400:kworker.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391472.049494:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391472.049535:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130835072:0@lo:400:kworker.0 00000100:00100000:1.0:1790391472.049562:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130834560:0@lo:400:kworker.0 00000100:00080000:2.0:1790391472.049870:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391472.049873:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391472.049907:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130834688:0@lo:400:kworker.0 00000100:00100000:2.0:1790391472.049915:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130835200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391472.049941:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391472.049969:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835200 00000100:00100000:2.0:1790391472.049973:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835200 00000100:00100000:2.0:1790391472.049999:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391472.050005:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130835200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391472.050040:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790391472.050072:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877361130835200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391472.050078:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391472.050114:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130835200:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1790391472.132143:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of acc7d8d9-5ca3-4792-891a-4d69befb1442 00000001:00080000:0.0:1790391472.132162:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1790391472.132170:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790391472.217221:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391473.241299:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391473.630609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.632702:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823680 00000100:00100000:0.0:1790391473.632717:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823680 00000100:00100000:0.0:1790391473.632804:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:0.0:1790391473.632816:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:13860:x1877361108823680:12345-192.168.201.8@tcp:41:lfs.0 00000004:00000024:0.0:1790391473.632858:0:14391:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790391473.632953:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:13860:x1877361108823680:12345-192.168.201.8@tcp:41:lfs.0 Request processed in 140us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.632961:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00080000:2.0:1790391473.633265:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391473.640838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.640957:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823808 00000100:00100000:0.0:1790391473.640968:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823808 00000100:00100000:0.0:1790391473.641081:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:0.0:1790391473.641092:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:13860:x1877361108823808:12345-192.168.201.8@tcp:13:lfs.0 00002000:00000024:0.0:1790391473.641131:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391473.641218:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:13860:x1877361108823808:12345-192.168.201.8@tcp:13:lfs.0 Request processed in 128us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.641226:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00080000:2.0:1790391473.641788:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391473.649999:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.651209:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108823936 00000100:00100000:0.0:1790391473.651221:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108823936 00000100:00100000:0.0:1790391473.651310:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1790391473.651321:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:13860:x1877361108823936:12345-192.168.201.8@tcp:13:lfs.0 00002000:00000024:0.0:1790391473.651360:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391473.651462:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:13860:x1877361108823936:12345-192.168.201.8@tcp:13:lfs.0 Request processed in 143us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.651469:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00080000:2.0:1790391473.651665:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391473.868008:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.868365:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824064 00000100:00100000:0.0:1790391473.868376:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824064 00000100:00100000:0.0:1790391473.868482:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00100000:0.0:1790391473.868494:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+10:13893:x1877361108824064:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391473.868510:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391473.868529:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e979400/0x35e94fc15449baed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f200ea expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391473.868559:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e979400/0x35e94fc15449baed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200ea expref: 11 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391473.868589:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e979400/0x35e94fc15449baed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200ea expref: 11 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391473.868599:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e979400, rc 0) 00000100:00100000:0.0:1790391473.868664:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13893:x1877361108824064:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 172us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.868671:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 92 00000100:00100000:3.0:1790391473.872400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.872580:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824192 00000100:00100000:0.0:1790391473.872590:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824192 00000100:00100000:0.0:1790391473.872648:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 93 00000100:00100000:0.0:1790391473.872658:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13893:x1877361108824192:12345-192.168.201.8@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790391473.872965:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13893:x1877361108824192:12345-192.168.201.8@tcp:501:mount.lustre.0 Request processed in 307us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.872974:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 93 00000100:00100000:3.0:1790391473.876136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391473.876233:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824320 00000100:00100000:2.0:1790391473.876244:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824320 00000100:00100000:2.0:1790391473.876302:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 94 00000100:00100000:2.0:1790391473.876313:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13893:x1877361108824320:12345-192.168.201.8@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790391473.876614:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13893:x1877361108824320:12345-192.168.201.8@tcp:503:mount.lustre.0 Request processed in 301us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391473.876622:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 94 00000100:00100000:3.0:1790391473.914147:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391473.914296:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824448 00000100:00100000:1.0:1790391473.914308:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824448 00000100:00100000:1.0:1790391473.914371:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 95 00000100:00100000:1.0:1790391473.914381:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13899:x1877361108824448:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391473.914685:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13899:x1877361108824448:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 303us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391473.914693:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 95 00000100:00100000:3.0:1790391473.932124:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.932282:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824576 00000100:00100000:0.0:1790391473.932293:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824576 00000100:00100000:0.0:1790391473.932355:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 96 00000100:00100000:0.0:1790391473.932366:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13899:x1877361108824576:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391473.932655:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13899:x1877361108824576:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 290us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.932663:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 96 00000100:00100000:3.0:1790391473.942214:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391473.942398:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824704 00000100:00100000:1.0:1790391473.942408:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824704 00000100:00100000:1.0:1790391473.942469:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 97 00000100:00100000:1.0:1790391473.942478:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13893:x1877361108824704:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790391473.942494:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391473.942511:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e30e00/0x35e94fc15449baf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20114 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391473.942536:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e30e00/0x35e94fc15449baf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20114 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391473.942547:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e30e00/0x35e94fc15449baf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20114 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391473.942573:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30e00, rc 0) 00000100:00100000:1.0:1790391473.942621:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13893:x1877361108824704:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 144us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391473.942627:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 97 00000100:00100000:3.0:1790391473.956404:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391473.956579:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824832 00000100:00100000:2.0:1790391473.956592:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824832 00000100:00100000:2.0:1790391473.956656:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 98 00000100:00100000:2.0:1790391473.956666:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13893:x1877361108824832:12345-192.168.201.8@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790391473.956691:0:14385:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790391473.956715:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790391473.956718:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790391473.956721:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790391473.956724:0:14385:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790391473.959656:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13893:x1877361108824832:12345-192.168.201.8@tcp:256:mount.lustre.0 Request processed in 2981us (3252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391473.959672:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 98 00000100:00100000:3.0:1790391473.964085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.964300:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108824960 00000100:00100000:0.0:1790391473.964311:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108824960 00000100:00100000:0.0:1790391473.964372:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 99 00000100:00100000:0.0:1790391473.964383:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13893:x1877361108824960:12345-192.168.201.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790391473.964411:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391473.964440:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2011b expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391473.964470:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391473.964481:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391473.964489:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96240e978000, rc 0) 00000100:00100000:0.0:1790391473.964552:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13893:x1877361108824960:12345-192.168.201.8@tcp:101:mount.lustre.0 Request processed in 171us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.964559:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 99 00000100:00100000:3.0:1790391473.968077:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391473.968325:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825088 00000100:00100000:2.0:1790391473.968336:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825088 00000100:00100000:2.0:1790391473.968395:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 100 00000100:00100000:2.0:1790391473.968405:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13893:x1877361108825088:12345-192.168.201.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790391473.968718:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13893:x1877361108825088:12345-192.168.201.8@tcp:501:mount.lustre.0 Request processed in 313us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391473.968737:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 100 00000100:00100000:3.0:1790391473.971365:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391473.972043:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825216 00000100:00100000:1.0:1790391473.972057:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825216 00000100:00100000:1.0:1790391473.972119:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 101 00000100:00100000:1.0:1790391473.972130:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13893:x1877361108825216:12345-192.168.201.8@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790391473.972352:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13893:x1877361108825216:12345-192.168.201.8@tcp:503:mount.lustre.0 Request processed in 222us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391473.972359:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 101 00000100:00100000:3.0:1790391473.975694:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391473.975766:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825344 00000100:00100000:0.0:1790391473.975776:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825344 00000100:00100000:0.0:1790391473.975848:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 102 00000100:00100000:0.0:1790391473.975858:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13903:x1877361108825344:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391473.976160:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13903:x1877361108825344:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 303us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391473.976169:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 102 00000100:00100000:3.0:1790391473.990795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391473.990966:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825472 00000100:00100000:2.0:1790391473.990984:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825472 00000100:00100000:2.0:1790391473.991075:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 103 00000100:00100000:2.0:1790391473.991086:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13903:x1877361108825472:12345-192.168.201.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391473.991635:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13903:x1877361108825472:12345-192.168.201.8@tcp:502:llog_process_th.0 Request processed in 549us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391473.991643:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 103 00000100:00100000:3.0:1790391473.997624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391473.997766:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825600 00000100:00100000:1.0:1790391473.997777:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825600 00000100:00100000:1.0:1790391473.999011:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:1.0:1790391473.999034:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1877361108825600:12345-192.168.201.8@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790391473.999067:0:14390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 557d2488-d495-4d5f-9acd-375292121937@192.168.201.8@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1790391473.999109:0:14390:0:(genops.c:1385:class_connect()) connect: client 557d2488-d495-4d5f-9acd-375292121937, cookie 0x35e94fc15449bb02 00000004:00100000:1.0:1790391473.999140:0:14390:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790391473.999257:0:14390:0:(import.c:65:import_set_state_nolock()) ffff962411e37800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391473.999329:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:557d2488-d495-4d5f-9acd-375292121937+6:2362:x1877361108825600:12345-192.168.201.8@tcp:38:mount.lustre.0 Request processed in 295us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391473.999337:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:3.0:1790391474.007374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391474.009149:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825856 00000100:00100000:1.0:1790391474.009165:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825856 00000100:00100000:1.0:1790391474.009274:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:1.0:1790391474.009284:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+6:13893:x1877361108825856:12345-192.168.201.8@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790391474.009334:0:14392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790391474.009413:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+6:13893:x1877361108825856:12345-192.168.201.8@tcp:41:mount.lustre.0 Request processed in 130us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391474.009431:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00080000:0.0:1790391474.011559:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391474.012141:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391474.012492:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825728 00000100:00100000:1.0:1790391474.012503:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825728 00000100:00100000:1.0:1790391474.012570:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:1.0:1790391474.012580:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+6:0:x1877361108825728:12345-192.168.201.8@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790391474.012612:0:14391:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790391474.012692:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+6:0:x1877361108825728:12345-192.168.201.8@tcp:41:mount.lustre.0 Request processed in 113us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391474.012711:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1790391474.023287:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391474.024729:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108825984 00000100:00100000:3.0:1790391474.024747:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108825984 00000100:00100000:3.0:1790391474.025182:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:3.0:1790391474.025196:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:557d2488-d495-4d5f-9acd-375292121937+6:13893:x1877361108825984:12345-192.168.201.8@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790391474.025316:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:557d2488-d495-4d5f-9acd-375292121937+6:13893:x1877361108825984:12345-192.168.201.8@tcp:40:mount.lustre.0 Request processed in 123us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.025323:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:2.0:1790391474.036714:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391474.036965:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391474.037005:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391474.037166:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108826112 00000100:00100000:0.0:1790391474.037176:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108826112 00000100:00100000:0.0:1790391474.037219:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108826240 00000100:00100000:0.0:1790391474.037245:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108826240 00000100:00100000:0.0:1790391474.037272:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1790391474.037281:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1877361108826112:12345-192.168.201.8@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790391474.037315:0:15075:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 557d2488-d495-4d5f-9acd-375292121937@192.168.201.8@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1790391474.037345:0:15075:0:(genops.c:1385:class_connect()) connect: client 557d2488-d495-4d5f-9acd-375292121937, cookie 0x35e94fc15449bb09 00002000:00100000:0.0:1790391474.037357:0:15075:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 557d2488-d495-4d5f-9acd-375292121937/ffff96243f8ff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391474.037368:0:15075:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391474.037499:0:15075:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391474.037530:0:15075:0:(import.c:65:import_set_state_nolock()) ffff96243f8ff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391474.037599:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:557d2488-d495-4d5f-9acd-375292121937+6:2362:x1877361108826112:12345-192.168.201.8@tcp:8:mount.lustre.0 Request processed in 318us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391474.037607:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:0.0:1790391474.037624:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:0.0:1790391474.037628:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1877361108826240:12345-192.168.201.8@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790391474.037645:0:15075:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 557d2488-d495-4d5f-9acd-375292121937@192.168.201.8@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1790391474.037665:0:15075:0:(genops.c:1385:class_connect()) connect: client 557d2488-d495-4d5f-9acd-375292121937, cookie 0x35e94fc15449bb10 00002000:00100000:0.0:1790391474.037670:0:15075:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 557d2488-d495-4d5f-9acd-375292121937/ffff96243f8fa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391474.037677:0:15075:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391474.037950:0:15075:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790391474.037984:0:15075:0:(import.c:65:import_set_state_nolock()) ffff96243fa41000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391474.038009:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:557d2488-d495-4d5f-9acd-375292121937+6:2362:x1877361108826240:12345-192.168.201.8@tcp:8:mount.lustre.0 Request processed in 379us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391474.038206:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:1.0:1790391474.040715:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108826368 00000100:00100000:1.0:1790391474.040729:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108826368 00000100:00100000:1.0:1790391474.040947:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:1.0:1790391474.040958:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:557d2488-d495-4d5f-9acd-375292121937+6:13893:x1877361108826368:12345-192.168.201.8@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790391474.041054:0:14394:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790391474.041133:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:557d2488-d495-4d5f-9acd-375292121937+6:13893:x1877361108826368:12345-192.168.201.8@tcp:33:mount.lustre.0 Request processed in 178us (4430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391474.041141:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00010000:00010000:0.0:1790391474.265234:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391474.280825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391474.281504:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108826496 00000100:00100000:0.0:1790391474.281515:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108826496 00000100:00100000:0.0:1790391474.281590:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:0.0:1790391474.281601:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+6:13924:x1877361108826496:12345-192.168.201.8@tcp:101:mkdir.0 00010000:00010000:0.0:1790391474.281622:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391474.281645:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030800/0x35e94fc15449bb17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20145 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391474.281715:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391474.281729:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391474.281742:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391474.281781:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790391474.281785:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790391474.281803:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391474.281830:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030800/0x35e94fc15449bb17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 8 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391474.281850:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 7 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391474.281860:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:0.0:1790391474.281862:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391474.281880:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030200, rc 0) 00000100:00100000:0.0:1790391474.281952:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+7:13924:x1877361108826496:12345-192.168.201.8@tcp:101:mkdir.0 Request processed in 353us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391474.281960:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391474.585577:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130835328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391474.585651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391474.589257:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835328 00000100:00100000:1.0:1790391474.589275:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835328 00000100:00100000:1.0:1790391474.589363:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391474.589375:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130835328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391474.589424:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790391474.589774:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391474.592001:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130835328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2620us (6340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391474.600916:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391474.602990:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130835328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391475.290142:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790391475.661548:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 557d2488-d495-4d5f-9acd-375292121937 00000001:00100000:0.0:1790391475.661568:0:6726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of acc7d8d9-5ca3-4792-891a-4d69befb1442 00010000:00010000:0.0:1790391476.313317:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790391476.724962:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 557d2488-d495-4d5f-9acd-375292121937 00000001:00100000:2.0:1790391476.724989:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of acc7d8d9-5ca3-4792-891a-4d69befb1442 00000100:00100000:1.0:1790391477.145420:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130835840:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391477.145555:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391477.145561:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130835456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145586:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391477.145606:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130835968:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145623:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391477.145644:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130835584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145664:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391477.145679:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130836096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145694:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391477.145708:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391477.145713:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130835712:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145727:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391477.145765:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835840 00000100:00100000:1.0:1790391477.145772:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835840 00000100:00100000:1.0:1790391477.145803:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835968 00000100:00100000:1.0:1790391477.145805:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835968 00000100:00100000:1.0:1790391477.145824:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130836096 00000100:00100000:1.0:1790391477.145826:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130836096 00000100:00100000:1.0:1790391477.145840:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391477.145848:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130835840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145903:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877361130835840:12345-0@lo:400:kworker.0 Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391477.145910:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391477.145927:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391477.145932:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130835968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145952:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130835968:12345-0@lo:400:kworker.0 Request processed in 21us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391477.145958:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391477.145966:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391477.145971:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130836096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.145993:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877361130836096:12345-0@lo:400:kworker.0 Request processed in 22us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391477.145999:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391477.146033:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835456 00000100:00100000:1.0:1790391477.146036:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835456 00000100:00100000:1.0:1790391477.146059:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391477.146065:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3307:x1877361130835456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146091:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3307:x1877361130835456:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391477.146097:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391477.146126:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835584 00000100:00100000:1.0:1790391477.146129:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835584 00000100:00100000:1.0:1790391477.146151:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130835712 00000100:00100000:1.0:1790391477.146153:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130835712 00000100:00100000:1.0:1790391477.146176:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391477.146182:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130835584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146215:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130835584:12345-0@lo:400:kworker.0 Request processed in 34us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391477.146221:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391477.146231:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391477.146236:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130835712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146255:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130835712:12345-0@lo:400:kworker.0 Request processed in 19us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391477.146260:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1790391477.146279:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391477.146282:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391477.146285:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391477.146312:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790391477.146326:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130835712:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146336:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130835584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146344:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1877361130836096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146364:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130835456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146384:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130835968:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.146393:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877361130835840:0@lo:400:kworker.0 00000100:00100000:1.0:1790391477.152054:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130836224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391477.152144:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391477.152574:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130836224 00000100:00100000:3.0:1790391477.152582:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130836224 00000100:00100000:3.0:1790391477.152639:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391477.152648:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130836224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391477.152718:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391477.152769:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130836224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391477.152776:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391477.152860:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130836224:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1790391477.244737:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 557d2488-d495-4d5f-9acd-375292121937 00000001:02000400:0.0:1790391477.301707:0:16356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1790391477.345386:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391478.366503:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391479.066690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391479.066772:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391479.066803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391479.066839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391479.066855:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391479.066869:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391479.066892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391479.067325:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827136 00000100:00100000:3.0:1790391479.067335:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827136 00000100:00100000:3.0:1790391479.067423:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108826752 00000100:00100000:3.0:1790391479.067426:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108826752 00000100:00100000:3.0:1790391479.067446:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:3.0:1790391479.067456:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+6:2366:x1877361108827136:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391479.067533:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+6:2366:x1877361108827136:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 78us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391479.067541:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:3.0:1790391479.067558:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:3.0:1790391479.067565:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2366:x1877361108826752:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391479.067589:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2366:x1877361108826752:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 25us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391479.067595:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:3.0:1790391479.067616:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108826880 00000100:00100000:3.0:1790391479.067620:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108826880 00000100:00100000:3.0:1790391479.067638:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827392 00000100:00100000:3.0:1790391479.067641:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827392 00000100:00100000:3.0:1790391479.067652:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827008 00000100:00100000:3.0:1790391479.067655:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827008 00000100:00100000:3.0:1790391479.067665:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827264 00000100:00100000:3.0:1790391479.067668:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827264 00000100:00100000:3.0:1790391479.067680:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:3.0:1790391479.067686:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2366:x1877361108826880:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391479.067719:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2366:x1877361108826880:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 34us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391479.067726:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:3.0:1790391479.067739:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:3.0:1790391479.067745:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:557d2488-d495-4d5f-9acd-375292121937+5:2366:x1877361108827392:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391479.067767:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:557d2488-d495-4d5f-9acd-375292121937+5:2366:x1877361108827392:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 23us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391479.067773:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:3.0:1790391479.067783:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1790391479.067789:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2366:x1877361108827008:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391479.067809:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2366:x1877361108827008:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 21us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391479.067815:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1790391479.067825:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:3.0:1790391479.067831:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:557d2488-d495-4d5f-9acd-375292121937+5:2366:x1877361108827264:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391479.067852:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:557d2488-d495-4d5f-9acd-375292121937+5:2366:x1877361108827264:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 21us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391479.067858:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00080000:3.0:1790391479.067874:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391479.067877:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391479.067880:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391479.071132:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108826624 00000100:00100000:0.0:1790391479.071148:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108826624 00000100:00100000:1.0:1790391479.071295:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 105 00000100:00100000:1.0:1790391479.071307:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:2366:x1877361108826624:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391479.071425:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:2366:x1877361108826624:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 120us (4745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.071433:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 105 00010000:00010000:2.0:1790391479.386064:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391479.711922:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130836352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391479.712004:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391479.712144:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130836352 00000100:00100000:3.0:1790391479.712152:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130836352 00000100:00100000:3.0:1790391479.712213:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391479.712223:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130836352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391479.712265:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790391479.717421:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391479.717825:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130836352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5599us (5816us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391479.717838:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391479.718599:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130836352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391480.411550:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391480.794076:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1790391481.011545:0:16503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff92d28b20 20000000:00000080:2.0:1790391481.011564:0:16503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962408a47800 uarg=0000000000000000 20000000:01000000:2.0:1790391481.011600:0:16503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790391481.011606:0:16503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790391481.011611:0:16503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790391481.012733:0:16504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1790391481.012887:0:16503:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790391481.019462:0:16503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790391481.019611:0:16503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019633:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b815 expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019642:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b862 expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019650:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449b996 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019659:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019666:0:16503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019674:0:16503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019722:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019738:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 12 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391481.019765:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836480:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391481.019904:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019923:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 12 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391481.019932:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836608:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391481.019965:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449b996 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.019973:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449b996 expref: 18 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391481.019982:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301246d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836736:0@lo:104: 00000100:00100000:3.0:1790391481.020051:0:16503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391481.020085:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449b862 expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.020092:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449b862 expref: 18 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391481.020100:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301247100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836864:0@lo:104: 00000100:00100000:3.0:1790391481.020132:0:16503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391481.020157:0:16503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x35e94fc15449b815 expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.020165:0:16503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x35e94fc15449b815 expref: 18 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391481.020179:0:16503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836992:0@lo:104: 00000100:00100000:3.0:1790391481.020203:0:16503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391481.020213:0:16503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052d9240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391481.020440:0:14373:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790391481.020454:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130836736 00000100:00100000:1.0:1790391481.020460:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130836736 00000100:00100000:1.0:1790391481.020499:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130836864 00000100:00100000:1.0:1790391481.020502:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130836864 00000100:00100000:1.0:1790391481.020513:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130836992 00000100:00100000:1.0:1790391481.020515:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130836992 00000100:00100000:1.0:1790391481.020526:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391481.020533:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+5:16503:x1877361130836736:12345-0@lo:104: 00010000:00010000:1.0:1790391481.020546:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020594:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391481.020600:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+5:16503:x1877361130836736:12345-0@lo:104: Request processed in 68us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.020607:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391481.020623:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391481.020628:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+4:16503:x1877361130836864:12345-0@lo:104: 00010000:00010000:1.0:1790391481.020636:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020673:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790391481.020678:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+4:16503:x1877361130836864:12345-0@lo:104: Request processed in 50us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.020684:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391481.020697:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391481.020702:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f90e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:16503:x1877361130836992:12345-0@lo:104: 00010000:00010000:1.0:1790391481.020709:0:14373:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020733:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790391481.020738:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f90e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+3:16503:x1877361130836992:12345-0@lo:104: Request processed in 36us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.020744:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790391481.020775:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790391481.020781:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020789:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e979600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391481.020793:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020802:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391481.020809:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391481.020815:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391481.020850:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020857:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391481.020876:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020882:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96240e979600/0x35e94fc15449b996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b99d expref: -99 pid: 15791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020895:0:14378:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391481.020899:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.020905:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e961e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1790391481.021043:0:14378:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.021053:0:14378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391481.021060:0:14378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391481.021065:0:14378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391481.021078:0:14378:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.021084:0:14378:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391481.021099:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.021205:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391481.021366:0:16505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391481.021384:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.021391:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96240e978a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1790391481.021394:0:14379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.021401:0:14379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391481.021407:0:14379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391481.021422:0:14379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391481.021436:0:14379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.021442:0:14379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391481.021449:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.021455:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96240e978a00/0x35e94fc15449b815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b81c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.021465:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391481.021467:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391481.021469:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391481.021474:0:16505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391481.021475:0:16505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391481.021556:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.108@tcp lock: ffff96240e961e00/0x35e94fc15449b862 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x35e94fc15449b869 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.021570:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391481.021572:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391481.021574:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391481.021598:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130837120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391481.021635:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391481.021691:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130837248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391481.021713:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391481.021731:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391481.021737:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130837376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391481.021758:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391481.021796:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130837120 00000100:00100000:1.0:1790391481.021802:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130837120 00010000:00010000:1.0:1790391481.021823:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b996 expref: 19 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391481.021840:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130837248 00000100:00100000:1.0:1790391481.021842:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130837248 00010000:00010000:1.0:1790391481.021852:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b862 expref: 20 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391481.021863:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130837376 00000100:00100000:1.0:1790391481.021865:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130837376 00010000:00010000:1.0:1790391481.021875:0:14376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b815 expref: 21 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391481.021899:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391481.021907:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+21:3308:x1877361130837120:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391481.022077:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301246d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836736:0@lo:104: 00000100:00100000:3.0:1790391481.022086:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301247100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836864:0@lo:104: 00000100:00100000:3.0:1790391481.022092:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301245500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836992:0@lo:104: 00010000:00010000:1.0:1790391481.022233:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391481.022239:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b996 expref: 21 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.022248:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449b996 expref: 21 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.022262:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962412f11a00/0x35e94fc15449b99d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449b996 expref: 21 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.022275:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391481.022321:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+20:3308:x1877361130837120:12345-0@lo:103:ldlm_bl.0 Request processed in 401us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.022328:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391481.022346:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391481.022352:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3309:x1877361130837248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391481.022360:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391481.022364:0:14376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b862 expref: 19 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391481.022485:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391481.022493:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790391481.022574:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391481.022581:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3309:x1877361130837376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391481.022590:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391481.022595:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x35e94fc15449b815 expref: 19 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391481.022649:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bbc90112-ffb7-4b19-a960-3ef7f783602e:3308:1877361130837120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391481.022692:0:14376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449b862 expref: 19 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391481.028958:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836480:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391481.028973:0:16503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16503:1877361130836608:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391481.029076:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391481.029143:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:0.0:1790391481.029745:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x35e94fc15449b815 expref: 19 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.029768:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e2800/0x35e94fc15449b81c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449b815 expref: 19 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.029802:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391481.029872:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:3309:x1877361130837376:12345-0@lo:103:ldlm_bl.0 Request processed in 7288us (8109us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391481.029882:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391481.029924:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391481.029935:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827520 00000100:00100000:0.0:1790391481.029941:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827520 00010000:00010000:0.0:1790391481.029967:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 13 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391481.029983:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391481.029987:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827648 00000100:00100000:0.0:1790391481.029990:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827648 00010000:00010000:0.0:1790391481.029999:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 14 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391481.030007:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391481.030037:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1790391481.030045:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+14:2363:x1877361108827520:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391481.030058:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391481.030063:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 14 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.030072:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 14 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.030082:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96240e978000/0x35e94fc15449bafb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2011b expref: 14 pid: 14382 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.030101:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391481.030149:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:2363:x1877361108827520:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 104us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391481.030156:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1790391481.030168:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391481.030175:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:0.0:1790391481.030182:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:2363:x1877361108827648:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391481.030190:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391481.030195:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 12 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.030205:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 12 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.030216:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96240e979200/0x35e94fc15449bac3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200b9 expref: 12 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.030224:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391481.030242:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:2363:x1877361108827648:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 61us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391481.030249:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:2.0:1790391481.030877:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130837376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391481.034619:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3000/0x35e94fc15449b869 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x35e94fc15449b862 expref: 17 pid: 14384 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034667:0:14376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034676:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034725:0:14376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034733:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034739:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034746:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034752:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391481.034758:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034766:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034775:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.034786:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391481.034879:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3309:x1877361130837248:12345-0@lo:103:ldlm_bl.0 Request processed in 12525us (13162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.034894:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391481.037814:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bbc90112-ffb7-4b19-a960-3ef7f783602e:3309:1877361130837248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391481.041553:0:16503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.041573:0:16503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.041580:0:16503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.041587:0:16503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb25 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.433345:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391482.286444:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130837504:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.286504:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.286546:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130838016:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.286565:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.286584:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391482.286587:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130837632:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.286602:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.286610:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130838144:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.286620:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.286636:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130837760:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.286656:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.286674:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391482.286679:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130837888:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.286704:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.286734:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130837504 00000100:00100000:1.0:1790391482.286741:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130837504 00000100:00100000:1.0:1790391482.286789:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391482.286799:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3307:x1877361130837504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.286972:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:3307:x1877361130837504:12345-0@lo:400:kworker.0 Request processed in 174us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.286980:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790391482.290423:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130837632 00000100:00100000:3.0:1790391482.290439:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130837632 00000100:00100000:3.0:1790391482.290495:0:15498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130837760 00000100:00100000:3.0:1790391482.290498:0:15498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130837760 00000100:00100000:3.0:1790391482.290525:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391482.290544:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130837632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391482.290626:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130837632:12345-0@lo:400:kworker.0 Request processed in 84us (4021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391482.290633:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391482.290649:0:15498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391482.290656:0:15498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130837760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391482.290699:0:15498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130837760:12345-0@lo:400:kworker.0 Request processed in 44us (4042us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391482.290705:0:15498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790391482.290785:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391482.290789:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391482.291093:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838016 00000100:00100000:1.0:1790391482.291098:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838016 00000100:00100000:1.0:1790391482.291128:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838144 00000100:00100000:1.0:1790391482.291136:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838144 00000100:00100000:1.0:1790391482.291151:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130837888 00000100:00100000:1.0:1790391482.291154:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130837888 00000100:00100000:1.0:1790391482.291164:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391482.291181:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130838016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291342:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130838016:12345-0@lo:400:kworker.0 Request processed in 172us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.291349:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391482.291363:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391482.291368:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130838144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291395:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877361130838144:12345-0@lo:400:kworker.0 Request processed in 27us (4773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.291401:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391482.291412:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391482.291418:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130837888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291443:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877361130837888:12345-0@lo:400:kworker.0 Request processed in 25us (4740us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.291449:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391482.291512:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130837632:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291525:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1877361130838144:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291536:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bbc90112-ffb7-4b19-a960-3ef7f783602e:3307:1877361130837504:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291545:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130838016:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291590:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130838272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391482.291624:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.291660:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877361130837888:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291670:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243a28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130837760:0@lo:400:kworker.0 00000100:00100000:1.0:1790391482.291783:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838272 00000100:00100000:1.0:1790391482.291787:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838272 00000100:00100000:1.0:1790391482.291814:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391482.291820:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130838272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391482.291937:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790391482.291979:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130838272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.291985:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391482.292188:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962301244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130838272:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790391482.292364:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391482.457313:0:16505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391482.769624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391482.769886:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827776 00000100:00100000:0.0:1790391482.769897:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827776 00000100:00100000:0.0:1790391482.769953:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 107 00000100:00100000:0.0:1790391482.769963:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+11:13781:x1877361108827776:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391482.769991:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391482.770009:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031800/0x35e94fc15449bb2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2014c expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.770053:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031800/0x35e94fc15449bb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2014c expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.770064:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031800/0x35e94fc15449bb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2014c expref: 12 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.770073:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031800, rc 0) 00000100:00100000:0.0:1790391482.770121:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13781:x1877361108827776:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 160us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391482.770128:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 107 00000100:00100000:2.0:1790391482.774850:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391482.774936:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108827904 00000100:00100000:3.0:1790391482.774947:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108827904 00000100:00100000:3.0:1790391482.775008:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00100000:3.0:1790391482.775115:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13781:x1877361108827904:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391482.775415:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13781:x1877361108827904:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 397us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391482.775423:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 108 00000100:00100000:0.0:1790391482.781972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391482.782068:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828032 00000100:00100000:1.0:1790391482.782078:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828032 00000100:00100000:1.0:1790391482.782172:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 109 00000100:00100000:1.0:1790391482.782194:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13781:x1877361108828032:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.782435:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13781:x1877361108828032:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 252us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.782443:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 109 10000000:01000000:2.0:1790391482.782518:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790391482.782522:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96242d067000 from 10 10000000:01000000:2.0:1790391482.782526:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391482.782566:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a1800/0x35e94fc15449bb33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391482.782589:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9624013a1800/0x35e94fc15449bb33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391482.782598:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9624013a1800/0x35e94fc15449bb33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391482.782628:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391482.782672:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391482.783339:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052af600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391482.783385:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838400 00000100:00100000:0.0:1790391482.783391:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838400 00000100:00100000:0.0:1790391482.783423:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790391482.783430:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+16:14387:x1877361130838400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391482.783441:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391482.783455:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400030600/0x35e94fc15449bb3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449bb33 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.783481:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400030600/0x35e94fc15449bb3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449bb33 expref: 17 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.783492:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400030600/0x35e94fc15449bb3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449bb33 expref: 17 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.783513:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030600, rc 0) 00000100:00100000:0.0:1790391482.783848:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:14387:x1877361130838400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 417us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391482.783856:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790391482.783957:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391482.783974:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9624013a1800/0x35e94fc15449bb33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb3a expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391482.783984:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9624013a1800/0x35e94fc15449bb33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449bb3a expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391482.784856:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391482.784905:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391482.784942:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052af600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391482.785000:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838528 00000100:00100000:0.0:1790391482.785006:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838528 00000100:00100000:0.0:1790391482.785071:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790391482.785079:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:14387:x1877361130838528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391482.785362:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:14387:x1877361130838528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391482.785370:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790391482.785410:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391482.785444:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391482.785484:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391482.785500:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241113e000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391482.785512:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838656 00000100:00100000:0.0:1790391482.785515:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838656 00000100:00100000:0.0:1790391482.785531:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790391482.785536:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:14387:x1877361130838656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391482.785910:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:14387:x1877361130838656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391482.785917:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790391482.785963:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391482.786937:0:16574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790391482.787983:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790391482.788260:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391482.788272:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a1800/0x35e94fc15449bb33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb3a expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391482.788295:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9624013a1800/0x35e94fc15449bb33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb3a expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391482.788306:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790391482.788308:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96243a7f1000 from 10 10000000:01000000:2.0:1790391482.788311:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391482.788348:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a0a00/0x35e94fc15449bb41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391482.788356:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff9624013a0a00/0x35e94fc15449bb41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391482.788366:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff9624013a0a00/0x35e94fc15449bb41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391482.788404:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96243f685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391482.788463:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391482.788532:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052af600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391482.788736:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838784 00000100:00100000:0.0:1790391482.788743:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838784 00000100:00100000:0.0:1790391482.788827:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790391482.788837:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+17:14387:x1877361130838784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391482.788850:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391482.788862:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962400031600/0x35e94fc15449bb48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449bb41 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.788885:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962400031600/0x35e94fc15449bb48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449bb41 expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.788895:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962400031600/0x35e94fc15449bb48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449bb41 expref: 18 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.788904:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031600, rc 0) 00000100:00100000:0.0:1790391482.788954:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:14387:x1877361130838784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391482.788961:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391482.789049:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96243f685180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391482.789064:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff9624013a0a00/0x35e94fc15449bb41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb48 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391482.789073:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff9624013a0a00/0x35e94fc15449bb41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449bb48 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391482.789136:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.789161:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.789371:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391482.789412:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130838912 00000100:00100000:2.0:1790391482.789417:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130838912 00000100:00100000:3.0:1790391482.789443:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790391482.789455:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:14387:x1877361130838912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391482.789887:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:14387:x1877361130838912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391482.789895:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790391482.789927:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130838912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.789959:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.789995:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.790111:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391482.790144:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130839040 00000100:00100000:2.0:1790391482.790148:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130839040 00000100:00100000:2.0:1790391482.790268:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790391482.790558:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:14387:x1877361130839040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391482.790741:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:14387:x1877361130839040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 465us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391482.790748:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790391482.790820:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790391482.791755:0:16575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790391482.791821:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790391482.791839:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391482.791850:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff9624013a0a00/0x35e94fc15449bb41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb48 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391482.791860:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff9624013a0a00/0x35e94fc15449bb41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb48 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391482.791871:0:14387:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391482.791874:0:14387:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962411e7e800 from 10 10000000:01000000:1.0:1790391482.791876:0:14387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391482.791907:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449bb4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391482.791915:0:14387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449bb4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391482.791936:0:14387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449bb4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391482.791956:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.791999:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391482.792381:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f20600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391482.796893:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130839168 00000100:00100000:0.0:1790391482.796910:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130839168 00000100:00100000:1.0:1790391482.797078:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790391482.797089:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+18:14387:x1877361130839168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391482.797107:0:14384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391482.797125:0:14384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962415e30200/0x35e94fc15449bb56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x35e94fc15449bb4f expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391482.797153:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962415e30200/0x35e94fc15449bb56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x35e94fc15449bb4f expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391482.797165:0:14384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962415e30200/0x35e94fc15449bb56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x35e94fc15449bb4f expref: 19 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391482.797173:0:14384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30200, rc 0) 00000100:00100000:1.0:1790391482.797263:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130839168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (5263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.797270:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790391482.797485:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391482.797504:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449bb4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb56 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391482.797515:0:14387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449bb4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x35e94fc15449bb56 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391482.797593:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391482.797805:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391482.797842:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241113e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391482.797884:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130839296 00000100:00100000:1.0:1790391482.797889:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130839296 00000100:00100000:1.0:1790391482.797909:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790391482.797914:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130839296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.798476:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130839296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 559us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.798484:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790391482.798763:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391482.798799:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391482.798842:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391482.798905:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241113e000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391482.798938:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130839424 00000100:00100000:1.0:1790391482.798943:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130839424 00000100:00100000:1.0:1790391482.800029:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790391482.800045:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130839424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.800553:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:14387:x1877361130839424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 512us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.800561:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790391482.800783:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bbc90112-ffb7-4b19-a960-3ef7f783602e:14387:1877361130839424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.801082:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391482.801172:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828160 00000100:00100000:3.0:1790391482.801179:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828160 00000100:00100000:3.0:1790391482.801215:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 119 00000100:00100000:3.0:1790391482.801232:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+12:13781:x1877361108828160:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391482.801243:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391482.801260:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20153 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391482.801298:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20153 expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391482.801310:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96243a2e3a00/0x35e94fc15449bb5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20153 expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391482.801319:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3a00, rc 0) 00000100:00100000:3.0:1790391482.801375:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13781:x1877361108828160:12345-192.168.201.8@tcp:101:ll_cfg_requeue.0 Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391482.801382:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 119 00000040:00080000:1.0:1790391482.802132:0:16576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790391482.802197:0:14387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790391482.802218:0:14387:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391482.802227:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449bb4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb56 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391482.802235:0:14387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.108@tcp lock: ffff962415e31000/0x35e94fc15449bb4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x35e94fc15449bb56 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391482.808765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391482.808938:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828288 00000100:00100000:1.0:1790391482.808949:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828288 00000100:00100000:1.0:1790391482.809043:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:1.0:1790391482.809067:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13781:x1877361108828288:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391482.809363:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13781:x1877361108828288:12345-192.168.201.8@tcp:501:ll_cfg_requeue.0 Request processed in 310us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391482.809371:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 120 00000100:00100000:2.0:1790391482.812362:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391482.813714:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828416 00000100:00100000:3.0:1790391482.813729:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828416 00000100:00100000:3.0:1790391482.813793:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 121 00000100:00100000:3.0:1790391482.813802:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13781:x1877361108828416:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391482.814078:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:13781:x1877361108828416:12345-192.168.201.8@tcp:503:ll_cfg_requeue.0 Request processed in 275us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391482.814088:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 121 00010000:00010000:0.0:1790391483.481586:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391484.170728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391484.170773:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391484.170815:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391484.170844:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391484.170884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391484.170914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391484.170952:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391484.170983:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828800 00000100:00100000:2.0:1790391484.170996:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828800 00000100:00100000:2.0:1790391484.171133:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108829312 00000100:00100000:2.0:1790391484.171137:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108829312 00000100:00100000:2.0:1790391484.171150:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828928 00000100:00100000:2.0:1790391484.171152:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828928 00000100:00100000:2.0:1790391484.171163:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108829184 00000100:00100000:2.0:1790391484.171165:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108829184 00000100:00100000:2.0:1790391484.171187:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:2.0:1790391484.171196:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108828800:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391484.171432:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108828800:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 228us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391484.171441:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:2.0:1790391484.171468:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391484.171476:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108829312:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391484.171501:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108829312:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391484.171507:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391484.171518:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:2.0:1790391484.171523:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108828928:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391484.171545:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108828928:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 21us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391484.171550:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:2.0:1790391484.171572:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:2.0:1790391484.171578:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108829184:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391484.171615:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108829184:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 37us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391484.171621:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:2.0:1790391484.171643:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108829056 00000100:00100000:2.0:1790391484.171647:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108829056 00000100:00100000:2.0:1790391484.171672:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828672 00000100:00100000:2.0:1790391484.171675:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828672 00000100:00100000:2.0:1790391484.171689:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:2.0:1790391484.171695:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:557d2488-d495-4d5f-9acd-375292121937+6:2363:x1877361108829056:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391484.171721:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:557d2488-d495-4d5f-9acd-375292121937+6:2363:x1877361108829056:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 27us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391484.171727:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:2.0:1790391484.171738:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:2.0:1790391484.171743:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2363:x1877361108828672:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:2.0:1790391484.171766:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2363:x1877361108828672:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 23us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391484.171772:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00080000:2.0:1790391484.171809:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391484.171814:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391484.171816:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391484.172657:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108828544 00000100:00100000:3.0:1790391484.172666:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108828544 00000100:00100000:3.0:1790391484.172716:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 122 00000100:00100000:3.0:1790391484.172724:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:2363:x1877361108828544:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391484.172779:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:2363:x1877361108828544:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 55us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391484.172786:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 122 00010000:00010000:0.0:1790391484.505224:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391484.827360:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391484.827385:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130839552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391484.827462:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391484.827623:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130839552 00000100:00100000:3.0:1790391484.827632:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130839552 00000100:00100000:3.0:1790391484.827705:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391484.827714:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130839552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391484.827749:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790391484.827797:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877361130839552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391484.827803:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391484.827850:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1877361130839552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391484.827928:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391484.951683:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391484.952055:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108829440 00000100:00100000:1.0:1790391484.952065:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108829440 00000100:00100000:1.0:1790391484.952127:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:1.0:1790391484.952136:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:14434:x1877361108829440:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391484.952156:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391484.952179:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449bb64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2015a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952295:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952320:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952334:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952348:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952355:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952360:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952837:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31400/0x35e94fc15449bb79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952847:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31400/0x35e94fc15449bb79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.952922:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31400/0x35e94fc15449bb79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391484.952946:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391484.952949:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391484.952984:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31400/0x35e94fc15449bb79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953006:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953035:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953042:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953048:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391484.953052:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953059:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953072:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:1.0:1790391484.953075:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391484.953079:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953085:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bb6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953097:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953104:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953108:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953119:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391484.953122:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953129:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953137:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9624128f8000) 00010000:00010000:1.0:1790391484.953139:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391484.953142:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953147:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bb72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953180:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449bb64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2015a expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953194:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31400/0x35e94fc15449bb79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2015a expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.953202:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9624128f8b00) 00010000:00010000:1.0:1790391484.953204:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391484.953207:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31400, rc 0) 00000100:00100000:1.0:1790391484.953395:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:14434:x1877361108829440:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 1259us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391484.953404:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 15 00000100:00100000:2.0:1790391484.958698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391484.963294:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108829696 00000100:00100000:1.0:1790391484.963327:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108829696 00000100:00100000:1.0:1790391484.963397:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1790391484.963525:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:14434:x1877361108829696:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391484.963549:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391484.963572:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bb80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20161 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.963658:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.963673:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.963685:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.963700:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.963707:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.963714:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964573:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449bb95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964586:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449bb95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964594:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449bb95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391484.964611:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790391484.964793:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964858:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964867:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964873:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391484.964878:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964885:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964896:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9624128f8b00) 00010000:00010000:1.0:1790391484.964899:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391484.964905:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964911:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bb87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964922:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964928:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964944:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964950:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391484.964953:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964959:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.964969:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9624128f8200) 00010000:00010000:1.0:1790391484.964972:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391484.965133:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.965140:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bb8e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.965644:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bb80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20161 expref: 10 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.965661:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31800/0x35e94fc15449bb95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20161 expref: 9 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391484.965669:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9624128f8000) 00010000:00010000:1.0:1790391484.965671:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391484.965674:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31800, rc 0) 00000100:00100000:1.0:1790391484.965799:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14434:x1877361108829696:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 2276us (7111us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790391484.971801:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:2.0:1790391484.977148:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391484.977233:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108829824 00000100:00100000:1.0:1790391484.977254:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108829824 00000100:00100000:1.0:1790391484.977325:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1790391484.977338:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14434:x1877361108829824:12345-192.168.201.8@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790391484.977459:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14434:x1877361108829824:12345-192.168.201.8@tcp:59:lhsmtool_posix.0 Request processed in 123us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391484.977466:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:2.0:1790391485.013405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391485.013482:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108829952 00000100:00100000:3.0:1790391485.013490:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108829952 00000100:00100000:3.0:1790391485.013607:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:3.0:1790391485.013621:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14440:x1877361108829952:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:3.0:1790391485.013641:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391485.013664:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20168 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013727:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013739:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013748:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013770:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013775:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013779:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013958:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013965:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013971:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013976:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391485.013980:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.013988:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014000:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:3.0:1790391485.014004:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391485.014009:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014249:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bbaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014271:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014277:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014282:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014287:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391485.014290:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014296:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014303:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962411373e00) 00010000:00010000:3.0:1790391485.014306:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391485.014309:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014315:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bbb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014347:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bba3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20168 expref: 10 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014358:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:3.0:1790391485.014361:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391485.014372:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20168 expref: 10 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.014381:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2000, rc 0) 00000100:00100000:3.0:1790391485.014496:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14440:x1877361108829952:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 879us (1102us total) trans 0 rc 301/301 00000100:00100000:3.0:1790391485.014515:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:2.0:1790391485.037336:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391485.042669:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108830080 00000100:00100000:3.0:1790391485.042687:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108830080 00000100:00100000:2.0:1790391485.042896:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391485.042908:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14440:x1877361108830080:12345-192.168.201.8@tcp:700:lfs.0 00000100:00100000:2.0:1790391485.043012:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14440:x1877361108830080:12345-192.168.201.8@tcp:700:lfs.0 Request processed in 105us (5685us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391485.043661:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391485.045128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.045271:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108830336 00000100:00100000:1.0:1790391485.045281:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108830336 00000100:00100000:1.0:1790391485.045336:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:1.0:1790391485.045346:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14440:x1877361108830336:12345-192.168.201.8@tcp:36:lfs.0 00010000:00010000:1.0:1790391485.045400:0:14392:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391485.045426:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96240e979800/0x35e94fc15449bae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f200e3 expref: 9 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.045446:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:1.0:1790391485.045451:0:14392:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391485.045676:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.045692:0:14392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 5 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.045700:0:14392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.045742:0:14392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 5 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.045755:0:14392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 5 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391485.045769:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14392:1877361130839680:192.168.201.8@tcp:104: 00000100:00100000:1.0:1790391485.045869:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391485.048728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.048833:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14392:1877361130839680:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391485.048872:0:14392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391485.048982:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108830464 00000100:00100000:3.0:1790391485.048989:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108830464 00010000:00010000:3.0:1790391485.049062:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 6 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391485.049098:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1790391485.049107:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:557d2488-d495-4d5f-9acd-375292121937+6:2364:x1877361108830464:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391485.049120:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391485.049127:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 6 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.049138:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 6 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.049158:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bb1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20145 expref: 6 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.049172:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:3.0:1790391485.049177:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.049198:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.049204:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.049227:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391485.049283:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:557d2488-d495-4d5f-9acd-375292121937+5:2364:x1877361108830464:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 177us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391485.049290:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00010000:00010000:2.0:1790391485.049819:0:14392:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.049828:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.049862:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.049872:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.049881:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391485.052470:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790391485.052492:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.053210:0:14392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.053220:0:14392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.053227:0:14392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391485.053232:0:14392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.053252:0:14392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.053269:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962430751700) 00010000:00010000:2.0:1790391485.053272:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391485.053278:0:14392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.053284:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bbb8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391485.053310:0:14392:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec526aaa reply state 000000009093a2bd transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391485.053320:0:14392:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391485.053477:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+10:14440:x1877361108830336:12345-192.168.201.8@tcp:36:lfs.0 Request processed in 8128us (8351us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790391485.053509:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00010000:00010000:2.0:1790391485.063679:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.063696:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.063704:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.063710:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391485.063715:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.063723:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.063740:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff962406a6fd00) 00010000:00010000:2.0:1790391485.063743:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391485.063748:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.063754:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bbbf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391485.160523:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.160618:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108830592 00000100:00100000:1.0:1790391485.160627:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108830592 00000100:00100000:1.0:1790391485.160685:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:1.0:1790391485.160695:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:14448:x1877361108830592:12345-192.168.201.8@tcp:101:lctl.0 00010000:00010000:1.0:1790391485.160717:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391485.160739:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bbc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2016f expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.160801:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bbcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.160816:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bbcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.160828:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bbcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391485.160863:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391485.160866:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391485.160914:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bbcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.161216:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bbc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2016f expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.161234:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30a00/0x35e94fc15449bbcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2016f expref: 10 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.161254:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:1.0:1790391485.161257:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391485.161261:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30a00, rc 0) 00000100:00100000:1.0:1790391485.161347:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+10:14448:x1877361108830592:12345-192.168.201.8@tcp:101:lctl.0 Request processed in 653us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391485.161354:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:1.0:1790391485.202149:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.203196:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108830720 00000100:00100000:2.0:1790391485.203209:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108830720 00000100:00100000:2.0:1790391485.203293:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:2.0:1790391485.203422:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+5:14449:x1877361108830720:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391485.203444:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391485.203476:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0400/0x35e94fc15449bbd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20176 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.203599:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0000/0x35e94fc15449bbdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.206188:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0000/0x35e94fc15449bbdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.206205:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0000/0x35e94fc15449bbdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391485.206267:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790391485.206272:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790391485.206295:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0000/0x35e94fc15449bbdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.206336:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0400/0x35e94fc15449bbd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20176 expref: 7 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.206360:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0000/0x35e94fc15449bbdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20176 expref: 6 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.206369:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:2.0:1790391485.206372:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391485.206376:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0000, rc 0) 00000100:00100000:2.0:1790391485.206513:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+6:14449:x1877361108830720:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 3095us (4373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391485.206522:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 21 00000100:00100000:2.0:1790391485.220903:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.220998:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108830848 00000100:00100000:1.0:1790391485.221009:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108830848 00000100:00100000:1.0:1790391485.221111:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:1.0:1790391485.221121:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+6:14449:x1877361108830848:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391485.221141:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391485.221160:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bbe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2017d expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221218:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221230:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221265:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221282:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221289:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221296:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221389:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bbf7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221397:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221405:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391485.221434:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391485.221437:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391485.221455:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221467:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221473:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221488:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221496:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391485.221501:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221508:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221519:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:1.0:1790391485.221522:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391485.221526:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221532:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bbe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221556:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221561:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221567:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221571:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391485.221574:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221590:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221599:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9624128f8a00) 00010000:00010000:1.0:1790391485.221602:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391485.221989:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.221999:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bbf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.222136:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bbe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2017d expref: 8 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.222151:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2017d expref: 7 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.222158:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9624128f8100) 00010000:00010000:1.0:1790391485.222160:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391485.222162:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30000, rc 0) 00000100:00100000:1.0:1790391485.222268:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+7:14449:x1877361108830848:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 1148us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391485.222276:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 22 00000100:00100000:3.0:1790391485.228974:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.229105:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108831104 00000100:00100000:2.0:1790391485.229116:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108831104 00000100:00100000:2.0:1790391485.229173:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:2.0:1790391485.229184:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+7:14449:x1877361108831104:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391485.229204:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391485.229223:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0400/0x35e94fc15449bbfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20184 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391485.229337:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790391485.229459:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0400/0x35e94fc15449bbfe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20184 expref: 9 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.229474:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:2.0:1790391485.229477:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391485.229482:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0400/0x35e94fc15449bbfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20184 expref: 9 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.229498:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0400, rc 0) 00000100:00100000:2.0:1790391485.229562:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+8:14449:x1877361108831104:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 380us (598us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1790391485.229569:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 23 00000100:00100000:3.0:1790391485.233315:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.233558:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108831360 00000100:00100000:2.0:1790391485.233568:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108831360 00000100:00100000:2.0:1790391485.233634:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 24 00000100:00100000:2.0:1790391485.233646:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:557d2488-d495-4d5f-9acd-375292121937+8:14449:x1877361108831360:12345-192.168.201.8@tcp:36:lfs.0 00010000:00010000:2.0:1790391485.233698:0:14390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391485.233724:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bbf7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2017d expref: 8 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.233758:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9624128f8100) 00010000:00010000:2.0:1790391485.233771:0:14390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391485.233794:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.233805:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.233815:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391485.234075:0:14390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dba6944 reply state 0000000082d58c07 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391485.234085:0:14390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790391485.234093:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790391485.234182:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:557d2488-d495-4d5f-9acd-375292121937+9:14449:x1877361108831360:12345-192.168.201.8@tcp:36:lfs.0 Request processed in 538us (887us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790391485.234189:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 24 00010000:00010000:1.0:1790391485.236580:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.236598:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.236636:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.236643:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391485.236648:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.236657:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.236673:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962406a6fd00) 00010000:00010000:1.0:1790391485.236677:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790391485.236682:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.236689:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc0c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391485.238573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.238789:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108831616 00000100:00100000:1.0:1790391485.238799:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108831616 00000100:00100000:1.0:1790391485.238859:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:1.0:1790391485.238870:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:557d2488-d495-4d5f-9acd-375292121937+8:14449:x1877361108831616:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:1.0:1790391485.239129:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:557d2488-d495-4d5f-9acd-375292121937+9:14449:x1877361108831616:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 261us (566us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790391485.239136:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:3.0:1790391485.242226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.242338:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108831872 00000100:00100000:1.0:1790391485.242349:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108831872 00000100:00100000:1.0:1790391485.242409:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:1.0:1790391485.242420:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+9:14449:x1877361108831872:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391485.242463:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391485.242486:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f2018b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.242579:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.242594:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.242905:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.242992:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243001:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243008:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391485.243134:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790391485.243216:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243224:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243230:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243260:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391485.243264:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243272:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243283:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:1.0:1790391485.243286:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391485.243291:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243812:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243829:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243835:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243991:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.243998:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391485.244001:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.244007:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.244707:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9624128f8a00) 00010000:00010000:1.0:1790391485.244711:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391485.244715:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.244722:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.244779:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc13 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2018b expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.244790:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:1.0:1790391485.244792:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391485.244796:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f2018b expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.244806:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30800, rc 0) 00000100:00100000:1.0:1790391485.245264:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+10:14449:x1877361108831872:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 2843us (3044us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1790391485.245274:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 25 00000100:00100000:3.0:1790391485.248197:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.248307:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108832000 00000100:00100000:1.0:1790391485.248317:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108832000 00000100:00100000:1.0:1790391485.248374:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:1.0:1790391485.248394:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+10:14449:x1877361108832000:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391485.248417:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391485.248438:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc2f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20192 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.248554:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.248573:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.248585:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391485.248619:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391485.248623:0:14392:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391485.248641:0:14392:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.248668:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc2f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 12 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.248686:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 11 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.248695:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9624128f8500) 00010000:00010000:1.0:1790391485.248697:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391485.248701:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30000, rc 0) 00000100:00100000:1.0:1790391485.248756:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:557d2488-d495-4d5f-9acd-375292121937+11:14449:x1877361108832000:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 372us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391485.248763:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 26 00000100:00100000:3.0:1790391485.254095:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.255056:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108832128 00000100:00100000:1.0:1790391485.255068:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108832128 00000100:00100000:1.0:1790391485.255143:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:1.0:1790391485.255153:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:557d2488-d495-4d5f-9acd-375292121937+11:14449:x1877361108832128:12345-192.168.201.8@tcp:37:lfs.0 00000100:00100000:1.0:1790391485.260793:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:557d2488-d495-4d5f-9acd-375292121937+11:14449:x1877361108832128:12345-192.168.201.8@tcp:37:lfs.0 Request processed in 5630us (6776us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391485.260807:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:3.0:1790391485.265007:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391485.265666:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108832384 00000100:00100000:0.0:1790391485.265676:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108832384 00000100:00100000:0.0:1790391485.265770:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:0.0:1790391485.265782:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f68b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:557d2488-d495-4d5f-9acd-375292121937+11:14449:x1877361108832384:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391485.266111:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f68b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:557d2488-d495-4d5f-9acd-375292121937+12:14449:x1877361108832384:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 329us (1111us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790391485.266120:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:3.0:1790391485.345478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.346974:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108832512 00000100:00100000:1.0:1790391485.346986:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108832512 00000100:00100000:1.0:1790391485.347365:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:1.0:1790391485.347378:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+10:14455:x1877361108832512:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391485.347400:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391485.347420:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f20199 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347484:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347498:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347510:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347525:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347532:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347539:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347983:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.347993:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348000:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391485.348338:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790391485.348343:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391485.348385:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348399:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348405:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348412:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348417:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391485.348422:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348430:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348443:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:1.0:1790391485.348453:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391485.348460:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348466:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348480:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348486:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348491:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348497:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391485.348500:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348506:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348513:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9624128f8a00) 00010000:00010000:1.0:1790391485.348515:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391485.348518:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348523:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348556:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20199 expref: 12 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348581:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31c00/0x35e94fc15449bc52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20199 expref: 11 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.348589:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9624128f8500) 00010000:00010000:1.0:1790391485.348592:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790391485.348594:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31c00, rc 0) 00000100:00100000:1.0:1790391485.349466:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+11:14455:x1877361108832512:12345-192.168.201.8@tcp:101:bash.0 Request processed in 2084us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391485.349476:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 27 00000100:00100000:3.0:1790391485.353620:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.353775:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108832768 00000100:00100000:2.0:1790391485.353786:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108832768 00000100:00100000:2.0:1790391485.353853:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 28 00000100:00100000:2.0:1790391485.353864:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+11:14455:x1877361108832768:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:2.0:1790391485.353888:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391485.353909:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0400/0x35e94fc15449bc59 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201a0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.354056:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.354084:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 11 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.354093:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.354140:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 11 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.354153:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 11 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391485.354169:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1877361130839808:192.168.201.8@tcp:104: 00000100:00100000:2.0:1790391485.356126:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff962401254c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391485.360001:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.360208:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1877361130839808:192.168.201.8@tcp:104: 00010000:00010000:2.0:1790391485.360272:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391485.360913:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108832896 00000100:00100000:0.0:1790391485.360969:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108832896 00010000:00010000:0.0:1790391485.361011:0:14377:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 12 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391485.361311:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1790391485.361321:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:557d2488-d495-4d5f-9acd-375292121937+12:2363:x1877361108832896:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391485.361336:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391485.361342:0:14377:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 12 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.361376:0:14377:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 12 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.361398:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bc36 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f20192 expref: 12 pid: 14392 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.361414:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9624128f8500) 00010000:00010000:0.0:1790391485.361419:0:14377:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.361430:0:14377:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.361437:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.361464:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391485.361515:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:557d2488-d495-4d5f-9acd-375292121937+11:2363:x1877361108832896:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 196us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391485.361523:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00010000:00010000:2.0:1790391485.361909:0:14390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.361928:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.361953:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.361962:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.361978:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.362805:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.362817:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.362825:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391485.362836:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790391485.363081:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363089:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363095:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363101:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391485.363105:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363113:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363124:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9624128f8500) 00010000:00010000:2.0:1790391485.363127:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391485.363140:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363147:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bc60 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391485.363161:0:14390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abffe5fb reply state 000000009b1f6091 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391485.363170:0:14390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790391485.363204:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0400/0x35e94fc15449bc59 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363220:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.363227:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:2.0:1790391485.363230:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790391485.363232:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a0600, rc 0) 00000100:00100000:2.0:1790391485.363311:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962301246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+14:14455:x1877361108832768:12345-192.168.201.8@tcp:101:bash.0 Request processed in 9448us (9712us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790391485.363319:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 28 00010000:00010000:2.0:1790391485.370897:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.370916:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.370923:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.370948:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391485.370953:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.370961:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.370979:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff962406a6f200) 00010000:00010000:2.0:1790391485.370983:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391485.370988:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.370996:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc67 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391485.379167:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.379252:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108833024 00000100:00100000:1.0:1790391485.379263:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108833024 00000100:00100000:1.0:1790391485.379324:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:1.0:1790391485.379335:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+13:14455:x1877361108833024:12345-192.168.201.8@tcp:101:bash.0 00010000:00010000:1.0:1790391485.379360:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391485.379382:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201a7 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.379455:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.379471:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.379482:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391485.379524:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790391485.379541:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790391485.379563:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.379575:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.379613:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 15 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.379633:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 14 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.379643:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:1.0:1790391485.379646:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391485.379650:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e31200, rc 0) 00000100:00100000:1.0:1790391485.379716:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+14:14455:x1877361108833024:12345-192.168.201.8@tcp:101:bash.0 Request processed in 382us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391485.379723:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:3.0:1790391485.385215:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.385430:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108833280 00000100:00100000:1.0:1790391485.385442:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108833280 00000100:00100000:1.0:1790391485.385490:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:1.0:1790391485.385500:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+14:14455:x1877361108833280:12345-192.168.201.8@tcp:35:bash.0 00000100:00100000:1.0:1790391485.386377:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+15:14455:x1877361108833280:12345-192.168.201.8@tcp:35:bash.0 Request processed in 874us (1169us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790391485.386387:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1790391485.494676:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.495191:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108833536 00000100:00100000:2.0:1790391485.495203:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108833536 00000100:00100000:2.0:1790391485.495281:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:2.0:1790391485.495292:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+15:14465:x1877361108833536:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:2.0:1790391485.495316:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391485.495337:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201ae expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391485.495437:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790391485.495558:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ae expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.495574:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9624128f8200) 00010000:00010000:2.0:1790391485.495589:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391485.495595:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bc8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ae expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.495625:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a1200, rc 0) 00000100:00100000:2.0:1790391485.495689:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+16:14465:x1877361108833536:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 399us (1023us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1790391485.495696:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:3.0:1790391485.502195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391485.502311:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108833792 00000100:00100000:0.0:1790391485.502322:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108833792 00000100:00100000:0.0:1790391485.502385:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:0.0:1790391485.502395:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+16:14465:x1877361108833792:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:0.0:1790391485.502656:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+17:14465:x1877361108833792:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 261us (470us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1790391485.502681:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00010000:00010000:0.0:1790391485.529160:0:16505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391485.537557:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.537805:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108834048 00000100:00100000:1.0:1790391485.537819:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108834048 00000100:00100000:1.0:1790391485.537949:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:1.0:1790391485.537973:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+17:14468:x1877361108834048:12345-192.168.201.8@tcp:101:lfs.0 00010000:00010000:1.0:1790391485.537998:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391485.538056:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201b5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.538161:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.538175:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.538188:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391485.538198:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790391485.538334:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bc98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201b5 expref: 20 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.538351:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201b5 expref: 19 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.538360:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:1.0:1790391485.538363:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391485.538366:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30800, rc 0) 00000100:00100000:1.0:1790391485.538427:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+19:14468:x1877361108834048:12345-192.168.201.8@tcp:101:lfs.0 Request processed in 455us (880us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1790391485.538433:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 31 00000100:00100000:3.0:1790391485.542203:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391485.542875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391485.542900:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108834304 00000100:00100000:3.0:1790391485.542929:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108834304 00000100:00100000:3.0:1790391485.542991:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:3.0:1790391485.543001:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+19:2365:x1877361108834304:12345-192.168.201.8@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790391485.543302:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108834176 00000100:00100000:2.0:1790391485.543308:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108834176 00000100:00100000:2.0:1790391485.543334:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 32 00000100:00100000:2.0:1790391485.543340:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+20:14468:x1877361108834176:12345-192.168.201.8@tcp:54:lfs.0 00010000:00010000:2.0:1790391485.543400:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543416:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543427:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543453:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543459:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543466:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543471:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1200 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:2.0:1790391485.543483:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543491:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543503:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:2.0:1790391485.543506:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391485.543510:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.543517:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391485.543592:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+20:14468:x1877361108834176:12345-192.168.201.8@tcp:54:lfs.0 Request processed in 250us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391485.543600:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 32 00010000:00010000:3.0:1790391485.543765:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391485.543781:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bc9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201b5 expref: 19 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.543792:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:3.0:1790391485.543795:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391485.543825:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:2365:x1877361108834304:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 826us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391485.543837:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:3.0:1790391485.545523:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.546564:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108834560 00000100:00100000:2.0:1790391485.546576:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108834560 00000100:00100000:2.0:1790391485.546748:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:2.0:1790391485.546762:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:14468:x1877361108834560:12345-192.168.201.8@tcp:35:lfs.0 00000100:00100000:2.0:1790391485.547222:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+19:14468:x1877361108834560:12345-192.168.201.8@tcp:35:lfs.0 Request processed in 463us (1706us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790391485.547240:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:3.0:1790391485.888368:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.888513:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108834816 00000100:00100000:2.0:1790391485.888532:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108834816 00000100:00100000:2.0:1790391485.888618:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:2.0:1790391485.888629:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+19:14499:x1877361108834816:12345-192.168.201.8@tcp:101:cat.0 00010000:00010000:2.0:1790391485.888661:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391485.888703:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201bc expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.888844:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bcbb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.888858:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.888873:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391485.888884:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790391485.889114:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bcb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201bc expref: 22 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.889134:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bcbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201bc expref: 21 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.889143:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:2.0:1790391485.889146:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391485.889149:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a1a00, rc 0) 00000100:00100000:2.0:1790391485.889220:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+21:14499:x1877361108834816:12345-192.168.201.8@tcp:101:cat.0 Request processed in 592us (868us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790391485.889237:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 33 00000100:00100000:1.0:1790391485.895403:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.895444:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.895539:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108835200 00000100:00100000:2.0:1790391485.895549:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108835200 00000100:00100000:2.0:1790391485.895615:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:2.0:1790391485.895625:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+21:2363:x1877361108835200:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391485.895651:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391485.895676:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1a00/0x35e94fc15449bcbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201bc expref: 21 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.895695:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:2.0:1790391485.895700:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391485.895771:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+20:2363:x1877361108835200:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 148us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391485.895779:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:3.0:1790391485.896060:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108835072 00000100:00100000:3.0:1790391485.896065:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108835072 00000100:00100000:3.0:1790391485.896097:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 8 00000100:00100000:3.0:1790391485.896104:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+20:14499:x1877361108835072:12345-192.168.201.8@tcp:35:cat.0 00000100:00100000:3.0:1790391485.896430:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+21:14499:x1877361108835072:12345-192.168.201.8@tcp:35:cat.0 Request processed in 326us (1037us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1790391485.896437:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 8 00000040:00080000:3.0:1790391485.913764:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391485.957998:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391485.958310:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108835456 00000100:00100000:0.0:1790391485.958322:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108835456 00000100:00100000:0.0:1790391485.958391:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:0.0:1790391485.958402:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+21:14505:x1877361108835456:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:0.0:1790391485.958428:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391485.958451:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449bcc9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201c3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.958674:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.958690:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 22 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.958700:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 22 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.958708:0:14391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.958743:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 22 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.958757:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 22 pid: 14391 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391485.958790:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14391:1877361130839936:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391485.958940:0:14391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 22 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.958951:0:14391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 22 pid: 14390 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391485.958959:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14391:1877361130840064:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391485.958986:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624113060c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391485.962194:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14391:1877361130839936:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391485.962209:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14391:1877361130840064:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391485.964765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391485.964803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.964911:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108835584 00000100:00100000:2.0:1790391485.964930:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108835584 00010000:00010000:2.0:1790391485.964971:0:16506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 23 pid: 14391 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391485.965058:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108835712 00000100:00100000:2.0:1790391485.965062:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108835712 00010000:00010000:2.0:1790391485.965077:0:16506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 24 pid: 14390 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391485.965099:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:2.0:1790391485.965107:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962427ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:2363:x1877361108835584:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391485.965123:0:16506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391485.965129:0:16506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 24 pid: 14391 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965143:0:16506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 24 pid: 14391 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965184:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31200/0x35e94fc15449bc83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a7 expref: 24 pid: 14391 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965200:0:16506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:2.0:1790391485.965206:0:16506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965215:0:16506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965221:0:16506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391485.965282:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962427ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+23:2363:x1877361108835584:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 175us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391485.965290:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:2.0:1790391485.965330:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 12 00000100:00100000:2.0:1790391485.965336:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+22:2363:x1877361108835712:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391485.965343:0:16506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391485.965348:0:16506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 22 pid: 14390 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965358:0:16506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 22 pid: 14390 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965369:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a0600/0x35e94fc15449bc6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201a0 expref: 22 pid: 14390 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965391:0:16506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:2.0:1790391485.965395:0:16506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965402:0:16506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965410:0:16506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.965425:0:16506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391485.965443:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+21:2363:x1877361108835712:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 107us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391485.965450:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 12 00010000:00010000:0.0:1790391485.966997:0:14391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.967083:0:14391:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.967092:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391485.967126:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790391485.969209:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449bcc9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201c3 expref: 22 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.969257:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030200/0x35e94fc15449bcd0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201c3 expref: 21 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.969281:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:0.0:1790391485.969284:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391485.969289:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030200, rc 0) 00000100:00100000:0.0:1790391485.969372:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+21:14505:x1877361108835456:12345-192.168.201.8@tcp:101:dd.0 Request processed in 10970us (11382us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1790391485.969381:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 34 00000100:00100000:3.0:1790391485.972961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391485.973175:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108835968 00000100:00100000:1.0:1790391485.973184:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108835968 00000100:00100000:1.0:1790391485.973249:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 35 00000100:00100000:1.0:1790391485.973260:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+21:14505:x1877361108835968:12345-192.168.201.8@tcp:36:dd.0 00010000:00010000:1.0:1790391485.973717:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.973736:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391485.973749:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391485.973798:0:14392:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1790391485.973897:0:14392:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a8ffeff reply state 00000000f7d4c62e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391485.973907:0:14392:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391485.974307:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:14505:x1877361108835968:12345-192.168.201.8@tcp:36:dd.0 Request processed in 1047us (1355us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1790391485.974315:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 35 00000020:00080000:1.0:1790391485.974320:0:14392:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790391485.976238:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.976274:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.976281:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.976287:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391485.976292:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.976300:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.976316:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:3.0:1790391485.976320:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391485.976325:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.976330:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31e00/0x35e94fc15449bcde lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391485.977192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391485.977252:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108836096 00000100:00100000:0.0:1790391485.977262:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108836096 00000100:00100000:0.0:1790391485.977320:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:0.0:1790391485.977330:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+23:14505:x1877361108836096:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:0.0:1790391485.977353:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391485.977371:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449bce5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201ca expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.977427:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449bce5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ca expref: 24 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.977441:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449bce5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ca expref: 24 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.977460:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:0.0:1790391485.977464:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391485.977467:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031e00, rc 0) 00000100:00100000:0.0:1790391485.977531:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:14505:x1877361108836096:12345-192.168.201.8@tcp:101:dd.0 Request processed in 201us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391485.977551:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 36 00000100:00100000:1.0:1790391485.989902:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391485.989976:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108836352 00000100:00100000:2.0:1790391485.989985:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108836352 00000100:00100000:2.0:1790391485.990078:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:2.0:1790391485.990088:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:14505:x1877361108836352:12345-192.168.201.8@tcp:103:dd.0 00010000:00010000:2.0:1790391485.990101:0:16506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391485.990123:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031e00/0x35e94fc15449bce5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ca expref: 24 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391485.990139:0:16506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:2.0:1790391485.990142:0:16506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391485.990190:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+23:14505:x1877361108836352:12345-192.168.201.8@tcp:103:dd.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391485.990195:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:1.0:1790391485.992273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391485.992383:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108836480 00000100:00100000:3.0:1790391485.992393:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108836480 00000100:00100000:3.0:1790391485.992746:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:3.0:1790391485.992758:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+23:14505:x1877361108836480:12345-192.168.201.8@tcp:58:dd.0 00010000:00010000:3.0:1790391485.992939:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.992958:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391485.992985:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391485.994050:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391485.994186:0:14392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1790391485.994252:0:14392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1790391485.994368:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+23:14505:x1877361108836480:12345-192.168.201.8@tcp:58:dd.0 Request processed in 1607us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391485.994379:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 37 00000100:00100000:2.0:1790391485.997008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391485.997100:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108836608 00000100:00100000:0.0:1790391485.997111:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108836608 00000100:00100000:0.0:1790391485.997167:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 38 00000100:00100000:0.0:1790391485.997178:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+23:14505:x1877361108836608:12345-192.168.201.8@tcp:101:dd.0 00010000:00010000:0.0:1790391485.997197:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391485.997220:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201d1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.997296:0:14391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.997307:0:14391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d1 expref: 24 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.997322:0:14391:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.997332:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d1 expref: 24 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.997342:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:0.0:1790391485.997344:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391485.997347:0:14391:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d1 expref: 24 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391485.997351:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400031000, rc 0) 00000100:00100000:0.0:1790391485.997401:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:14505:x1877361108836608:12345-192.168.201.8@tcp:101:dd.0 Request processed in 227us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391485.997419:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 38 00010000:00010000:0.0:1790391486.553169:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391486.971476:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790391486.971488:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391486.975071:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790391486.975088:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790391486.975233:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b74a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14423:1877361130840192:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391486.975350:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff962439f203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391486.990242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391486.994869:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108836736 00000100:00100000:2.0:1790391486.994887:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108836736 00000100:00100000:2.0:1790391486.994979:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391486.995001:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108836736:12345-192.168.201.8@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790391486.995116:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108836736:12345-192.168.201.8@tcp:900:lhsmtool_posix.0 Request processed in 127us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391486.995125:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00080000:2.0:1790391486.995145:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391486.997759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391486.997959:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108836864 00000100:00100000:3.0:1790391486.997968:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108836864 00000100:00100000:3.0:1790391486.998050:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:3.0:1790391486.998061:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108836864:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790391486.998096:0:14392:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790391486.998206:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108836864:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 146us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391486.998223:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 39 00000100:00100000:1.0:1790391487.000136:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b74a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14423:1877361130840192:192.168.201.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391487.009768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.010623:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108836992 00000100:00100000:3.0:1790391487.010638:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108836992 00000100:00100000:3.0:1790391487.010751:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1790391487.010761:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:14506:x1877361108836992:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790391487.010830:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010848:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010863:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010915:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010923:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010931:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010953:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010960:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.010966:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391487.011134:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790391487.011138:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391487.011153:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011164:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011170:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011177:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011194:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391487.011198:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011217:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011229:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9624128f8000) 00010000:00010000:3.0:1790391487.011232:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391487.011236:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011242:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bcfa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011255:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011323:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011331:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011337:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391487.011340:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011346:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011362:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff962411373e00) 00010000:00010000:3.0:1790391487.011365:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391487.011368:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011373:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd01 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011388:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011393:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011399:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011404:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391487.011407:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011412:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011418:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:3.0:1790391487.011420:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391487.011423:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.011428:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391487.011882:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:14506:x1877361108836992:12345-192.168.201.8@tcp:34:lhsmtool_posix.0 Request processed in 743us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391487.011894:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 40 00000100:00100000:3.0:1790391487.014299:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391487.014637:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108837248 00000100:00100000:0.0:1790391487.014648:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108837248 00000100:00100000:0.0:1790391487.014710:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:0.0:1790391487.014720:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+24:14506:x1877361108837248:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391487.014739:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391487.014759:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201d8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.014880:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.014896:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.014907:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391487.014918:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790391487.015083:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015091:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015282:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015302:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391487.015306:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015314:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015326:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:0.0:1790391487.015329:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790391487.015334:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015344:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015598:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd0f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d8 expref: 26 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015609:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9624128f8000) 00010000:00010000:0.0:1790391487.015612:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391487.015616:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d8 expref: 26 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.015627:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962400030400, rc 0) 00000100:00100000:0.0:1790391487.015700:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108837248:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 980us (1410us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1790391487.015708:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 41 00000100:00100000:1.0:1790391487.019989:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.024394:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108837376 00000100:00100000:3.0:1790391487.024414:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108837376 00000100:00100000:0.0:1790391487.024604:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:0.0:1790391487.024629:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108837376:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391487.024663:0:14390:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391487.024777:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108837376:12345-192.168.201.8@tcp:53:lhsmtool_posix.0 Request processed in 151us (4798us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391487.024785:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 42 00000100:00100000:1.0:1790391487.029550:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.029703:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108837632 00000100:00100000:3.0:1790391487.029715:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108837632 00000100:00100000:3.0:1790391487.029782:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:3.0:1790391487.029792:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+25:14506:x1877361108837632:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391487.029812:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391487.029833:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd24 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201df expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391487.030701:0:14392:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1790391487.030710:0:14392:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1790391487.030763:0:14392:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1790391487.031090:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449bd2b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.031107:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449bd2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.031120:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449bd2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.031182:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2400/0x35e94fc15449bd24 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201df expref: 28 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.031202:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449bd2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201df expref: 27 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.031225:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962406a6f200) 00010000:00010000:2.0:1790391487.031228:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391487.031239:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9624013a1e00, rc 0) 00000100:00100000:2.0:1790391487.031320:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+27:14506:x1877361108837632:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 1529us (1782us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790391487.031329:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 43 00000100:00100000:3.0:1790391487.036695:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.036766:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108837888 00000100:00100000:1.0:1790391487.036776:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108837888 00000100:00100000:1.0:1790391487.036845:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:1.0:1790391487.036855:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+27:14506:x1877361108837888:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391487.037064:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391487.037092:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1e00/0x35e94fc15449bd2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201df expref: 27 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037176:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962406a6f200) 00010000:00010000:1.0:1790391487.037188:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391487.037224:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037237:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037248:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037263:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037270:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037276:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037575:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037584:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037591:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037597:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30000 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391487.037602:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037609:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037619:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9624128f8500) 00010000:00010000:1.0:1790391487.037623:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391487.037627:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037633:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30000/0x35e94fc15449bd39 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037643:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037649:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037655:0:14391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037666:0:14391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e30600 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:1.0:1790391487.037670:0:14391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037676:0:14391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037683:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5234315f (ffff9624128f8a00) 00010000:00010000:1.0:1790391487.037686:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391487.037688:0:14391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.037694:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30600/0x35e94fc15449bd40 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5234315f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391487.037798:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+26:14506:x1877361108837888:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 943us (1114us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391487.037806:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 44 00000100:00100000:1.0:1790391487.039548:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.039635:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108838016 00000100:00100000:3.0:1790391487.039645:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108838016 00000100:00100000:3.0:1790391487.039698:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:3.0:1790391487.039708:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+26:14506:x1877361108838016:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391487.039725:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391487.039744:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201e6 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.039779:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bd4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.039793:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bd4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.039823:0:14392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bd4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.039909:0:14392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201e6 expref: 28 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.039925:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2000/0x35e94fc15449bd4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201e6 expref: 27 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.039934:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:3.0:1790391487.039937:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391487.039940:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e2000, rc 0) 00000100:00100000:3.0:1790391487.039989:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+27:14506:x1877361108838016:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 282us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391487.039994:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 45 00000100:00100000:1.0:1790391487.047158:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.047312:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108838272 00000100:00100000:3.0:1790391487.047323:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108838272 00000100:00100000:3.0:1790391487.047384:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 46 00000100:00100000:3.0:1790391487.047395:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+27:14506:x1877361108838272:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790391487.047478:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.047496:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.047507:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391487.048001:0:14391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1790391487.048041:0:14391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 522381996372ns, next at 523381993909ns, rc = 0 00000004:00010000:3.0:1790391487.048130:0:14391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae8e7a2d reply state 00000000ba466943 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391487.048140:0:14391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391487.048245:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+29:14506:x1877361108838272:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 850us (1096us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1790391487.048252:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 46 00000001:00080000:2.0:1790391487.052176:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:2.0:1790391487.052198:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1790391487.052219:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000100:00100000:3.0:1790391487.052396:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.052513:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108838400 00000100:00100000:1.0:1790391487.052523:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108838400 00000100:00100000:1.0:1790391487.052575:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 47 00000100:00100000:1.0:1790391487.052586:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+16:14506:x1877361108838400:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391487.052608:0:14392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391487.052629:0:14392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201ed expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.052712:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 17 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.052727:0:14392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 17 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.052749:0:14392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:1.0:1790391487.052753:0:14392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391487.052757:0:14392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30800, rc 0) 00000100:00100000:1.0:1790391487.052879:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+17:14506:x1877361108838400:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 294us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391487.052888:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 47 00010000:00010000:0.0:1790391487.060481:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.060501:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.060508:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.060515:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2800 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391487.060520:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.060527:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.060545:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:0.0:1790391487.060548:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790391487.060553:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.060560:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2800/0x35e94fc15449bd55 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391487.061793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391487.061870:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108838528 00000100:00100000:2.0:1790391487.061880:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108838528 00000100:00100000:2.0:1790391487.061957:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:2.0:1790391487.061969:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108838528:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790391487.062380:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2363:x1877361108838528:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 412us (592us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790391487.062388:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00080000:0.0:1790391487.062457:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391487.064793:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.064871:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108838784 00000100:00100000:3.0:1790391487.064881:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108838784 00000100:00100000:3.0:1790391487.064937:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1790391487.064949:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+16:14506:x1877361108838784:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790391487.070314:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+17:14506:x1877361108838784:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 5354us (5514us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1790391487.070331:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 9 00000100:00100000:3.0:1790391487.077768:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391487.077851:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108839040 00000100:00100000:0.0:1790391487.077875:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108839040 00000100:00100000:0.0:1790391487.077948:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:0.0:1790391487.077958:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+17:14506:x1877361108839040:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391487.078103:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+17:14506:x1877361108839040:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391487.078111:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 48 00000100:00100000:1.0:1790391487.080658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.086560:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108839168 00000100:00100000:3.0:1790391487.086579:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108839168 00000100:00100000:3.0:1790391487.086646:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:3.0:1790391487.086659:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+17:14506:x1877361108839168:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391487.086683:0:14391:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391487.086709:0:14391:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201f4 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.086815:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3000/0x35e94fc15449bd6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.086830:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3000/0x35e94fc15449bd6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.086843:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3000/0x35e94fc15449bd6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391487.086885:0:14391:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790391487.086903:0:14391:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3000/0x35e94fc15449bd6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.086928:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3e00/0x35e94fc15449bd63 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201f4 expref: 19 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.086948:0:14391:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3000/0x35e94fc15449bd6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201f4 expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.086956:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:3.0:1790391487.086959:0:14391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790391487.086962:0:14391:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96243a2e3000, rc 0) 00000100:00100000:3.0:1790391487.087083:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:14506:x1877361108839168:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 427us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391487.087091:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 49 00000100:00100000:2.0:1790391487.094359:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.094473:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108839296 00000100:00100000:1.0:1790391487.094484:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108839296 00000100:00100000:1.0:1790391487.094553:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:1.0:1790391487.094565:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2364:x1877361108839296:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391487.094587:0:15074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391487.094609:0:15074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3f3aff4759f201fb expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391487.094638:0:15074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab734be, blocks: 0x1 00010000:00010000:1.0:1790391487.094660:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1790391487.094665:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391487.094692:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 7 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.094716:0:15074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 7 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.094731:0:15074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962415e30000, rc 0) 00000100:00100000:1.0:1790391487.094802:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2364:x1877361108839296:12345-192.168.201.8@tcp:101:lhsmtool_posix.0 Request processed in 239us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391487.094810:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391487.112746:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.112860:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108839552 00000100:00100000:1.0:1790391487.112871:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108839552 00000100:00100000:1.0:1790391487.112933:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:1.0:1790391487.112943:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:14506:x1877361108839552:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790391487.113110:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:14506:x1877361108839552:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391487.113118:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 50 00000100:00100000:3.0:1790391487.124328:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391487.124435:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108839680 00000100:00100000:0.0:1790391487.124444:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108839680 00000100:00100000:0.0:1790391487.124507:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 51 00000100:00100000:0.0:1790391487.124517:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:14506:x1877361108839680:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790391487.191317:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1790391487.191343:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1790391487.191348:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1790391487.191354:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1790391487.191504:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130840320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790391487.191578:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391487.191655:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130840320 00000100:00100000:0.0:1790391487.191663:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130840320 00000100:00100000:0.0:1790391487.191718:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391487.191727:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1877361130840320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790391487.191893:0:15075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790391487.191897:0:15075:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790391487.191899:0:15075:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790391487.191901:0:15075:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790391486 -> 1790391486 00002000:00010000:0.0:1790391487.191903:0:15075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790391487.191948:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1877361130840320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (369us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790391487.191969:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790391487.191989:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391487.192008:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+14:14506:x1877361108839680:12345-192.168.201.8@tcp:44:lhsmtool_posix.0 Request processed in 67491us (67692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391487.192047:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 51 00000004:00080000:0.0:1790391487.193333:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962439c70380/2, rc 0, transno 8589934595 00000100:00100000:0.0:1790391487.193348:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1877361130840320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790391487.204602:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.205373:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108839808 00000100:00100000:1.0:1790391487.205384:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108839808 00000100:00100000:1.0:1790391487.205451:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:1.0:1790391487.205462:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2363:x1877361108839808:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1790391487.205596:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2363:x1877361108839808:12345-192.168.201.8@tcp:16:lhsmtool_posix.0 Request processed in 134us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391487.205605:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 16 00000100:00100000:3.0:1790391487.220665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.220739:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108840064 00000100:00100000:1.0:1790391487.220763:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108840064 00000100:00100000:1.0:1790391487.223459:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 52 00000100:00100000:1.0:1790391487.223489:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+14:14506:x1877361108840064:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391487.224288:0:14391:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391487.224321:0:14391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e3000/0x35e94fc15449bd6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201f4 expref: 14 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.224345:0:14391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:1.0:1790391487.224351:0:14391:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391487.224385:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.224400:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.224411:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391487.224621:0:14391:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bfad4e6 reply state 00000000bb94f5a9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391487.224632:0:14391:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391487.224756:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+15:14506:x1877361108840064:12345-192.168.201.8@tcp:36:lhsmtool_posix.0 Request processed in 1279us (4097us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1790391487.224765:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 52 00010000:00010000:3.0:1790391487.237942:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391487.237964:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00010000:00010000:3.0:1790391487.237965:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.237972:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.237979:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31a00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:3.0:1790391487.237984:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.237993:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.238038:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:3.0:1790391487.238041:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391487.238047:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.238053:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e31a00/0x35e94fc15449bd78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391487.238459:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108840192 00000100:00100000:0.0:1790391487.238471:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108840192 00000100:00100000:0.0:1790391487.238536:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:0.0:1790391487.238547:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2364:x1877361108840192:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790391487.238754:0:15075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790391487.238759:0:15075:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790391485 00002000:00010000:0.0:1790391487.238761:0:15075:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790391485 00002000:00010000:0.0:1790391487.238763:0:15075:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790391486 -> 1790391485 00002000:00010000:0.0:1790391487.238765:0:15075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790391487.238836:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+8:2364:x1877361108840192:12345-192.168.201.8@tcp:2:lhsmtool_posix.0 Request processed in 290us (875us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790391487.238844:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1790391487.243058:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.243280:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108840320 00000100:00100000:3.0:1790391487.243291:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108840320 00000100:00100000:3.0:1790391487.243350:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:3.0:1790391487.243362:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+8:2364:x1877361108840320:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790391487.243423:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243440:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391487.243445:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391487.243453:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243469:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243516:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243526:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243535:0:15074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243542:0:15074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391487.243547:0:15074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243557:0:15074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243586:0:15074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.243595:0:15074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bd7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391487.243676:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+8:2364:x1877361108840320:12345-192.168.201.8@tcp:1:lhsmtool_posix.0 Request processed in 315us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391487.243684:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:3.0:1790391487.254182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:0.0:1790391487.254301:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108840576 00000100:00100000:0.0:1790391487.254312:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108840576 00000100:00100000:0.0:1790391487.254384:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 53 00000100:00100000:0.0:1790391487.254396:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+14:14506:x1877361108840576:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790391487.254479:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.254498:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.254524:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.254793:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.254806:0:14390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 15 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.254816:0:14390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.254858:0:14390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 15 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.254873:0:14390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 15 pid: 14392 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391487.254890:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1877361130840448:192.168.201.8@tcp:104: 00000100:00100000:0.0:1790391487.255010:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff962427c89540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391487.258578:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1877361130840448:192.168.201.8@tcp:104: 00010000:00010000:0.0:1790391487.258611:0:14390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391487.267152:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.271638:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108840704 00000100:00100000:1.0:1790391487.271656:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108840704 00010000:00010000:1.0:1790391487.271713:0:14377:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 16 pid: 14392 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391487.271796:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 13 00000100:00100000:1.0:1790391487.272217:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+16:2364:x1877361108840704:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391487.272240:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391487.272248:0:14377:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 16 pid: 14392 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.272421:0:14377:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 16 pid: 14392 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.272447:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962415e30800/0x35e94fc15449bd5c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201ed expref: 16 pid: 14392 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.272488:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:1.0:1790391487.272495:0:14377:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.272891:0:14377:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.272901:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391487.273063:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391487.273173:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+15:2364:x1877361108840704:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 1365us (6030us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391487.273184:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 13 00010000:00010000:0.0:1790391487.278948:0:14390:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.278968:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391487.279986:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1790391487.280286:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1790391487.280332:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1790391487.280429:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1877361130840576:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391487.280708:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391487.280815:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391487.282254:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130840576 00000100:00100000:2.0:1790391487.282267:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130840576 00000100:00100000:2.0:1790391487.282367:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391487.282377:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96230208ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1877361130840576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790391487.282518:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96230208ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1877361130840576:12345-0@lo:1000:mdt00_000.0 Request processed in 142us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391487.282525:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391487.282616:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1877361130840576:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790391487.283404:0:14390:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1790391487.283495:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96230208b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1877361130840704:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391487.283555:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391487.283580:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7f900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391487.283857:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130840704 00000100:00100000:1.0:1790391487.283870:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130840704 00000100:00100000:1.0:1790391487.283917:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391487.283925:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1877361130840704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790391487.284133:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14390:x1877361130840704:12345-0@lo:1000:mdt00_000.0 Request processed in 208us (577us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790391487.284140:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391487.284432:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96230208b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14390:1877361130840704:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790391487.284469:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284478:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284485:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284491:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391487.284495:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284502:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284519:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00010000:00010000:0.0:1790391487.284522:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391487.284537:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284544:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031c00/0x35e94fc15449bd8d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284575:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284581:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284586:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284591:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e2c00 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391487.284594:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284599:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284608:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:0.0:1790391487.284610:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391487.284616:0:14390:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d1 expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284627:0:14390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d1 expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284637:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d1 expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.284698:0:14390:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff962400031000/0x35e94fc15449bcf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201d1 expref: 18 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391487.284711:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962302089180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1877361130840832:192.168.201.8@tcp:105: 00000100:00100000:0.0:1790391487.284770:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff96241bf7f540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391487.287752:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391487.288078:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108840832 00000100:00100000:2.0:1790391487.288089:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108840832 00000100:00100000:2.0:1790391487.288144:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:2.0:1790391487.288154:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243f688c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+19:14505:x1877361108840832:12345-192.168.201.8@tcp:49:dd.0 00000100:00100000:2.0:1790391487.288328:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243f688c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+19:14505:x1877361108840832:12345-192.168.201.8@tcp:49:dd.0 Request processed in 175us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391487.288335:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 10 00000100:00100000:0.0:1790391487.288471:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962302089180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14390:1877361130840832:192.168.201.8@tcp:105: 00010000:00010000:0.0:1790391487.288497:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288508:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96243a2e2c00/0x35e94fc15449bcec lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14392 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288542:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288556:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288567:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288576:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288582:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288587:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288603:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400030400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391487.288607:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288613:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288624:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:0.0:1790391487.288627:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391487.288631:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288636:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400030400/0x35e94fc15449bd94 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288647:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288653:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288658:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288663:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc21db4f0) 00010000:00010000:0.0:1790391487.288666:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288672:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288691:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962406a6fb00) 00010000:00010000:0.0:1790391487.288694:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790391487.288698:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.288703:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962400031400/0x35e94fc15449bd86 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391487.288908:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:14506:x1877361108840576:12345-192.168.201.8@tcp:57:lhsmtool_posix.0 Request processed in 34513us (34739us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1790391487.288918:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 53 00000020:00080000:0.0:1790391487.288922:0:14390:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790391487.292837:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790391487.292849:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391487.292890:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790391487.292897:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790391487.293772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391487.293854:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841088 00000100:00100000:2.0:1790391487.293865:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841088 00000100:00100000:2.0:1790391487.293969:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 11 00000100:00100000:2.0:1790391487.293980:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+18:14506:x1877361108841088:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790391487.294709:0:14393:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790391487.294802:0:14393:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790391487.294843:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.294861:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.294873:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.294881:0:14393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.294888:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.294894:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.294919:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391487.294991:0:14379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391487.294998:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.295005:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1200 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391487.295009:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.295032:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391487.295034:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:acc7d8d9-5ca3-4792-891a-4d69befb1442+20:14506:x1877361108841088:12345-192.168.201.8@tcp:35:lhsmtool_posix.0 Request processed in 1056us (1268us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790391487.295043:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 11 00010000:00010000:0.0:1790391487.295045:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962411373e00) 00000020:00080000:2.0:1790391487.295048:0:14393:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790391487.295048:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790391487.295053:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.295059:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9624013a1200/0x35e94fc15449bd9b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.295082:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391487.295084:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391487.295085:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391487.387235:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130840960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391487.388169:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391487.388605:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130841216:0@lo:400:kworker.0 00000100:00100000:2.0:1790391487.388642:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391487.388662:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391487.388667:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbc90112-ffb7-4b19-a960-3ef7f783602e:3310:1877361130841088:0@lo:400:kworker.0 00000100:00100000:2.0:1790391487.388692:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391487.388719:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130841088 00000100:00100000:2.0:1790391487.388725:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130841088 00000100:00100000:2.0:1790391487.388766:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790391487.388774:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3310:x1877361130841088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391487.389033:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130840960 00000100:00100000:0.0:1790391487.389038:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130840960 00000100:00100000:2.0:1790391487.389156:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbc90112-ffb7-4b19-a960-3ef7f783602e+19:3310:x1877361130841088:12345-0@lo:400:kworker.0 Request processed in 381us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391487.389164:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790391487.389217:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bbc90112-ffb7-4b19-a960-3ef7f783602e:3310:1877361130841088:0@lo:400:kworker.0 00000100:00100000:2.0:1790391487.389242:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130841216 00000100:00100000:2.0:1790391487.389245:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130841216 00000100:00100000:0.0:1790391487.390142:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391487.390156:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130840960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391487.390191:0:15078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790391487.391038:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877361130840960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 882us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391487.391047:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391487.391176:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391487.391188:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130841216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391487.391405:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877361130841216:12345-0@lo:400:kworker.0 Request processed in 220us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391487.391413:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790391487.391463:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391487.391481:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130841344:0@lo:400:kworker.0 00000100:00100000:0.0:1790391487.391796:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96242d00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130841472:0@lo:400:kworker.0 00000100:00100000:3.0:1790391487.392059:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877361130841216:0@lo:400:kworker.0 00000100:00100000:0.0:1790391487.392559:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391487.392604:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1877361130840960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391487.392730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391487.393054:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130841472 00000100:00100000:3.0:1790391487.393061:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130841472 00000100:00100000:3.0:1790391487.393181:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130841344 00000100:00100000:3.0:1790391487.393185:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130841344 00000100:00100000:3.0:1790391487.393215:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391487.393224:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962302089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130841472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391487.393596:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790391487.393605:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790391487.393703:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391487.393711:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96242d00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130841344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391487.393754:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96242d00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877361130841344:12345-0@lo:400:kworker.0 Request processed in 44us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391487.393762:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391487.394183:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962302089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877361130841472:12345-0@lo:400:kworker.0 Request processed in 958us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391487.394192:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391487.394250:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1877361130841472:0@lo:400:kworker.0 00000100:00080000:2.0:1790391487.395356:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391487.395391:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96242d00ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1877361130841344:0@lo:400:kworker.0 00000100:00100000:1.0:1790391487.560868:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.560912:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.560954:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.561066:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841216 00000100:00100000:3.0:1790391487.561090:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841216 00000100:00100000:3.0:1790391487.561145:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841344 00000100:00100000:3.0:1790391487.561149:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841344 00000100:00100000:3.0:1790391487.561162:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841472 00000100:00100000:3.0:1790391487.561164:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841472 00000100:00100000:3.0:1790391487.561179:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:3.0:1790391487.561190:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+10:2363:x1877361108841216:12345-192.168.201.8@tcp:4:dd.0 00010000:00010000:3.0:1790391487.561234:0:15080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.561254:0:15080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 10 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.561263:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391487.561267:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391487.561272:0:15080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.561307:0:15080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 10 pid: 15074 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.561323:0:15080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 10 pid: 15074 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391487.561337:0:15080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439b4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15080:1877361130841600:192.168.201.8@tcp:104: 00000100:00100000:3.0:1790391487.561426:0:15080:0:(client.c:2716:ptlrpc_set_wait()) set ffff9624052d9180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391487.567836:0:15080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439b4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15080:1877361130841600:192.168.201.8@tcp:104: 00010000:00010000:3.0:1790391487.567883:0:15080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391487.573767:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391487.573872:0:16506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841600 00000100:00100000:2.0:1790391487.573882:0:16506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841600 00010000:00010000:2.0:1790391487.573923:0:16506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 11 pid: 15074 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391487.573966:0:16506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 14 00000100:00100000:2.0:1790391487.573976:0:16506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+11:2363:x1877361108841600:12345-192.168.201.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391487.573991:0:16506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391487.574051:0:16506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 11 pid: 15074 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.574074:0:16506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 11 pid: 15074 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.574096:0:16506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041913d40/0x35e94fc15449bd71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.8@tcp remote: 0x3f3aff4759f201fb expref: 11 pid: 15074 timeout: 622 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.574113:0:16506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391487.574117:0:16506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391487.574123:0:16506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.574153:0:16506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.574185:0:16506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391487.574247:0:16506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+10:2363:x1877361108841600:12345-192.168.201.8@tcp:103:ldlm_bl.0 Request processed in 272us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391487.574261:0:16506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 14 00010000:00010000:3.0:1790391487.574771:0:15080:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391487.574783:0:15080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.577600:0:16505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790391487.782696:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1790391487.782733:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1790391487.782741:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1790391487.789917:0:15080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1790391487.789928:0:15080:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790391485 -> 1790391486 00002000:00010000:2.0:1790391487.789931:0:15080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1790391487.789960:0:15080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.789974:0:15080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.789991:0:15080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.789999:0:15080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96243a2e3e00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:2.0:1790391487.790004:0:15080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.790063:0:15080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.790309:0:15080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.790320:0:15080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b44911/0x35e94fc15449bda2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391487.790444:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2363:x1877361108841216:12345-192.168.201.8@tcp:4:dd.0 Request processed in 229250us (229582us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1790391487.790458:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 0 00000100:00100000:2.0:1790391487.790502:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:2.0:1790391487.790514:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2363:x1877361108841344:12345-192.168.201.8@tcp:4:dd.0 00002000:00010000:2.0:1790391487.790554:0:15080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6ab734be, atime: 0x6ab734bd, ctime: 0x0, blocks: 0x803 00010000:00010000:2.0:1790391487.790561:0:15080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.790572:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1790391487.790576:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391487.790582:0:15080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.790595:0:15080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391487.886176:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1790391487.886339:0:15080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1790391487.886345:0:15080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1790391487.886374:0:15080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886387:0:15080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886396:0:15080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886403:0:15080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391487.886408:0:15080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886417:0:15080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886436:0:15080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886444:0:15080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bda9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391487.886544:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2363:x1877361108841344:12345-192.168.201.8@tcp:4:dd.0 Request processed in 96029us (325626us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790391487.886559:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 1 00000100:00100000:0.0:1790391487.886587:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 2 00000100:00100000:0.0:1790391487.886598:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108841472:12345-192.168.201.8@tcp:4:dd.0 00002000:00010000:0.0:1790391487.886645:0:15080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6ab734be, atime: 0x6ab734bd, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1790391487.886652:0:15080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886664:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1790391487.886668:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391487.886676:0:15080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.886689:0:15080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391487.949388:0:15080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1790391487.949398:0:15080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1790391487.949414:0:15080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.949428:0:15080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.949437:0:15080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.949444:0:15080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391487.949448:0:15080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.949474:0:15080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.949492:0:15080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391487.949499:0:15080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046281148/0x35e94fc15449bdb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391487.949591:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2363:x1877361108841472:12345-192.168.201.8@tcp:4:dd.0 Request processed in 62993us (388631us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790391487.949600:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 2 00000001:00080000:0.0:1790391487.950133:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:3.0:1790391487.983604:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391487.984791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391487.990849:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841728 00000100:00100000:2.0:1790391487.990864:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841728 00000100:00100000:2.0:1790391487.990929:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841856 00000100:00100000:2.0:1790391487.990932:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841856 00000100:00100000:2.0:1790391487.990959:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:2.0:1790391487.990968:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+6:2364:x1877361108841728:12345-192.168.201.8@tcp:4:dd.0 00002000:00010000:2.0:1790391487.991012:0:15081:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6ab734be, atime: 0x6ab734bd, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1790391487.991036:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.991052:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1790391487.991057:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391487.991062:0:15081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.994060:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391487.994543:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:3.0:1790391487.995548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391487.995625:0:15080:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1790391487.995635:0:15080:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1790391487.996092:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108841984 00000100:00100000:1.0:1790391487.996101:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108841984 00000100:00100000:1.0:1790391487.996166:0:15080:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1790391487.996172:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108842112 00000100:00100000:1.0:1790391487.996175:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108842112 00000100:00100000:2.0:1790391488.000685:0:16624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 4 00000100:00100000:2.0:1790391488.000705:0:16624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+9:2364:x1877361108841856:12345-192.168.201.8@tcp:4:dd.0 00010000:00010000:2.0:1790391488.000927:0:16624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391488.000947:0:16624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391488.000958:0:16624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391488.000965:0:16624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391488.000981:0:16624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391488.009914:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:2.0:1790391488.010338:0:15080:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1790391488.010351:0:15080:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1790391488.011264:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108842240 00000100:00100000:1.0:1790391488.011275:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108842240 00000100:00100000:2.0:1790391488.012528:0:16625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:2.0:1790391488.012546:0:16625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243a28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:acc7d8d9-5ca3-4792-891a-4d69befb1442+10:2364:x1877361108841984:12345-192.168.201.8@tcp:4:dd.0 00010000:00010000:2.0:1790391488.012587:0:16625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391488.012605:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391488.012609:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391488.012616:0:16625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391488.012631:0:16625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391488.133524:0:15081:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1790391488.133535:0:15081:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790391486 -> 1790391487 00002000:00010000:1.0:1790391488.133538:0:15081:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790391487 00002000:00010000:1.0:1790391488.133541:0:15081:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1790391488.133557:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391488.133572:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391488.133587:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00010000:00010000:1.0:1790391488.133597:0:15081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391488.133604:0:15081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a1a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:1.0:1790391488.133610:0:15081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391488.133620:0:15081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391488.133641:0:15081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391488.133649:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010d0a4f8/0x35e94fc15449bdb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391488.133748:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+15:2364:x1877361108841728:12345-192.168.201.8@tcp:4:dd.0 Request processed in 142776us (150148us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790391488.133758:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 3 00000100:00100000:1.0:1790391488.133787:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 6 00000100:00100000:1.0:1790391488.133808:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+14:2364:x1877361108842112:12345-192.168.201.8@tcp:4:dd.0 00010000:00010000:1.0:1790391488.133838:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391488.133849:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391488.133860:0:15081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391488.133868:0:15081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391488.133880:0:15081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391488.222918:0:16625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1790391488.222930:0:16625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1790391488.222946:0:16625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.222960:0:16625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.222968:0:16625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.222975:0:16625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0600 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391488.222991:0:16625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.223002:0:16625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.223049:0:16625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.223059:0:16625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a125a98b/0x35e94fc15449bdc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391488.223252:0:16625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:acc7d8d9-5ca3-4792-891a-4d69befb1442+16:2364:x1877361108841984:12345-192.168.201.8@tcp:4:dd.0 Request processed in 210705us (228708us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1790391488.223264:0:16625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 5 00000100:00100000:0.0:1790391488.223297:0:16625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 7 00000100:00100000:0.0:1790391488.223308:0:16625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:acc7d8d9-5ca3-4792-891a-4d69befb1442+15:2364:x1877361108842240:12345-192.168.201.8@tcp:4:dd.0 00010000:00010000:0.0:1790391488.223340:0:16625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.223354:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391488.223634:0:16625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391488.223644:0:16625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.223659:0:16625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391488.224332:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:2.0:1790391488.224350:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:0.0:1790391488.224501:0:16624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.224512:0:16624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.224520:0:16624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.224527:0:16624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9624013a0400 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391488.224530:0:16624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.224539:0:16624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.224552:0:16624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.224560:0:16624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc20a95/0x35e94fc15449bdbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391488.224608:0:16624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:acc7d8d9-5ca3-4792-891a-4d69befb1442+11:2364:x1877361108841856:12345-192.168.201.8@tcp:4:dd.0 Request processed in 223907us (239819us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1790391488.224617:0:16624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 4 00000001:00080000:1.0:1790391488.255937:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1790391488.256062:0:15081:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1790391488.256457:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391488.256472:0:15081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391488.256480:0:15081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391488.256487:0:15081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962415e31a00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:3.0:1790391488.256492:0:15081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391488.256501:0:15081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391488.256533:0:15081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391488.256541:0:15081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000935b4d9a/0x35e94fc15449bdcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391488.256707:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2364:x1877361108842112:12345-192.168.201.8@tcp:4:dd.0 Request processed in 122908us (261158us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1790391488.256718:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 6 00002000:00010000:0.0:1790391488.333705:0:16625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1790391488.333715:0:16625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1790391488.333729:0:16625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.333743:0:16625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.333753:0:16625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.333761:0:16625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962400031c00 already unused, calling callback (ffffffffc17974f0) 00010000:00010000:0.0:1790391488.333766:0:16625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.333776:0:16625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.333964:0:16625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391488.333974:0:16625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076bf8572/0x35e94fc15449bdd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391488.334225:0:16625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:acc7d8d9-5ca3-4792-891a-4d69befb1442+7:2364:x1877361108842240:12345-192.168.201.8@tcp:4:dd.0 Request processed in 110914us (324316us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790391488.334236:0:16625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 7 00000001:00080000:0.0:1790391488.334284:0:6726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1790391488.601158:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391489.302180:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391489.302228:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391489.302265:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391489.302294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391489.302311:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391489.302328:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391489.302366:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.8@tcp (source: 12345-192.168.201.8@tcp) 00000100:00100000:1.0:1790391489.302402:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108842752 00000100:00100000:1.0:1790391489.302411:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108842752 00000100:00100000:1.0:1790391489.302454:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108843008 00000100:00100000:1.0:1790391489.302457:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108843008 00000100:00100000:1.0:1790391489.302469:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108842624 00000100:00100000:1.0:1790391489.302471:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108842624 00000100:00100000:1.0:1790391489.302481:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108843136 00000100:00100000:1.0:1790391489.302483:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108843136 00000100:00100000:1.0:1790391489.302496:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1790391489.302505:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108842752:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391489.302573:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108842752:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 68us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391489.302580:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 17 00000100:00100000:1.0:1790391489.302595:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1790391489.302611:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108843008:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391489.302636:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108843008:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391489.302642:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 18 00000100:00100000:1.0:1790391489.302654:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:1.0:1790391489.302660:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108842624:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391489.302684:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:acc7d8d9-5ca3-4792-891a-4d69befb1442+5:2363:x1877361108842624:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391489.302690:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 19 00000100:00100000:1.0:1790391489.302700:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:1.0:1790391489.302706:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108843136:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391489.302728:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:557d2488-d495-4d5f-9acd-375292121937+5:2363:x1877361108843136:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391489.302733:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 20 00000100:00100000:1.0:1790391489.302750:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108842368 00000100:00100000:1.0:1790391489.302753:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108842368 00000100:00100000:1.0:1790391489.302772:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:1.0:1790391489.302778:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962411ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:2363:x1877361108842368:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:1.0:1790391489.302799:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962411ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8785f6fb-acab-4133-9d0f-dbdf7bea48cd+13:2363:x1877361108842368:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 21us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391489.302804:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 124 00000100:00100000:3.0:1790391489.302902:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108842496 00000100:00100000:3.0:1790391489.302906:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108842496 00000100:00100000:3.0:1790391489.302954:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361108842880 00000100:00100000:3.0:1790391489.302957:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361108842880 00000100:00100000:3.0:1790391489.302979:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:3.0:1790391489.302986:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+20:2363:x1877361108842496:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391489.303053:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:acc7d8d9-5ca3-4792-891a-4d69befb1442+20:2363:x1877361108842496:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 68us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391489.303059:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 29 00000100:00100000:3.0:1790391489.303073:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00100000:3.0:1790391489.303079:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962439988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+6:2363:x1877361108842880:12345-192.168.201.8@tcp:400:kworker.0 00000100:00100000:3.0:1790391489.303105:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962439988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:557d2488-d495-4d5f-9acd-375292121937+6:2363:x1877361108842880:12345-192.168.201.8@tcp:400:kworker.0 Request processed in 26us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391489.303112:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.8@tcp, seq: 30 00000100:00080000:2.0:1790391489.303292:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391489.303298:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391489.303300:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790391489.631946:0:14379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391489.945392:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391489.945417:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130841728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391489.945488:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391489.945560:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361130841728 00000100:00100000:1.0:1790391489.945567:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361130841728 00000100:00100000:1.0:1790391489.945623:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391489.945633:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130841728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391489.945670:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1790391489.945717:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96243998aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877361130841728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391489.945723:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790391489.945744:0:14386:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391489.945773:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1790391489.945778:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962439c70380, transno 8589934595 00000004:00080000:1.0:1790391489.945790:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1790391489.945830:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff962439989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1877361130841728:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1790391490.244465:0:16662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:2.0:1790391490.393300:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790391490.393312:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391490.393345:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790391490.393351:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1790391490.649572:0:16505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391491.673247:0:14378:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29476 lines, 29476 kept, 0 dropped, 0 bad.